2024-04-26T17:50:50.999 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T17:50:50.999 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903 --name leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi --verbose --owner scheduled_leonidus@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} -- /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/orig.config.yaml 2024-04-26T17:50:51.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T17:50:51.151 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903 branch: wip-lusov-quiescer-fixes description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} email: null first_in_suite: false job_id: '7674903' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer-fixes ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer-fixes sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 9496 sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer-fixes suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh4gicuwpWNkWrgMw6npH86SLVh3ZLenmbFRF2tO4z9De5eSKtJQhe/3cfs3OkaGPLEk1kqHVzT7LPscCOYfIg= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5AauhDX9kwFG0a316z1l/XqokJARJUaIYbaH1QmJs55p4cEfchci940vvkoN3eZIrmq7rOEdUjSKSIm5XvH0k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-26_17:24:23 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T17:50:51.151 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa; will attempt to use it 2024-04-26T17:50:51.152 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks 2024-04-26T17:50:51.152 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T17:50:51.154 INFO:teuthology.task.internal:Checking packages... 2024-04-26T17:50:51.179 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1' 2024-04-26T17:50:51.179 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T17:50:51.179 INFO:teuthology.packaging:ref: None 2024-04-26T17:50:51.179 INFO:teuthology.packaging:tag: None 2024-04-26T17:50:51.179 INFO:teuthology.packaging:branch: wip-lusov-quiescer-fixes 2024-04-26T17:50:51.179 INFO:teuthology.packaging:sha1: bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:50:51.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer-fixes 2024-04-26T17:50:51.324 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3267.gbc94a2a9 2024-04-26T17:50:51.325 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T17:50:51.331 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T17:50:51.331 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T17:50:51.337 INFO:teuthology.task.internal:Saving configuration 2024-04-26T17:50:51.359 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T17:50:51.365 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T17:50:51.386 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:58.396757', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh4gicuwpWNkWrgMw6npH86SLVh3ZLenmbFRF2tO4z9De5eSKtJQhe/3cfs3OkaGPLEk1kqHVzT7LPscCOYfIg='} 2024-04-26T17:50:51.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:58.394780', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5AauhDX9kwFG0a316z1l/XqokJARJUaIYbaH1QmJs55p4cEfchci940vvkoN3eZIrmq7rOEdUjSKSIm5XvH0k='} 2024-04-26T17:50:51.410 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T17:50:51.416 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-26T17:50:51.416 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-26T17:50:51.416 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T17:50:51.483 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd955df60d0>, signals=[15]) 2024-04-26T17:50:51.483 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T17:50:51.489 INFO:teuthology.task.internal:Opening connections... 2024-04-26T17:50:51.489 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:50:51.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:50:51.568 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:50:51.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:50:51.643 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T17:50:51.649 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2024-04-26T17:50:51.667 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2024-04-26T17:50:51.667 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:50:51.726 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:50:51.727 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:50:51.727 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:50:51.727 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:50:51.727 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:50:51.727 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2024-04-26T17:50:51.744 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-04-26T17:50:51.762 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-04-26T17:50:51.762 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-26T17:50:51.819 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-26T17:50:51.820 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-26T17:50:51.820 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-04-26T17:50:51.844 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T17:50:51.853 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T17:50:51.858 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T17:50:51.858 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:50:51.861 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-04-26T17:50:51.876 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T17:50:51.881 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T17:50:51.881 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:50:51.918 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-04-26T17:50:51.944 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T17:50:51.998 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T17:50:52.012 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-26T17:50:52.012 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-26T17:50:52.012 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-26T17:50:52.012 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:50:52.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:50:52.030 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2024-04-26T17:50:52.087 INFO:teuthology.orchestra.run.smithi012.stdout:5.14.0-437.el9.x86_64 2024-04-26T17:50:52.088 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.14.0-437.el9.x86_64 2024-04-26T17:50:52.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum install -y kernel 2024-04-26T17:50:54.606 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-04-26T17:50:59.481 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 19 MB 00:03 2024-04-26T17:51:03.764 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-04-26T17:51:05.990 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 16 kB 00:01 2024-04-26T17:51:07.350 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-26T17:51:12.540 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-26T17:51:14.496 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-26T17:51:14.497 INFO:teuthology.orchestra.run.smithi012.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-26T17:51:14.586 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-04-26T17:51:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2024-04-26T17:51:14.587 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-04-26T17:51:14.686 DEBUG:teuthology.orchestra.run.smithi012:> echo no | sudo yum reinstall kernel || true 2024-04-26T17:51:15.205 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 05:51:12 PM UTC. 2024-04-26T17:51:15.330 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-04-26T17:51:15.345 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:Reinstalling: 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 255 k 2024-04-26T17:51:15.346 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 0 2024-04-26T17:51:15.347 INFO:teuthology.orchestra.run.smithi012.stderr:Operation aborted. 2024-04-26T17:51:15.408 INFO:teuthology.orchestra.run.smithi012.stdout:Is this ok [y/N]: 2024-04-26T17:51:15.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum reinstall -y kernel || true 2024-04-26T17:51:15.925 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:00:03 ago on Fri 26 Apr 2024 05:51:12 PM UTC. 2024-04-26T17:51:16.046 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout: Package Architecture Version Repository Size 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:Reinstalling: 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:================================================================================ 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:16.047 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 255 k 2024-04-26T17:51:16.048 INFO:teuthology.orchestra.run.smithi012.stdout:Installed size: 0 2024-04-26T17:51:16.048 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-04-26T17:51:16.334 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.2 MB/s | 255 kB 00:00 2024-04-26T17:51:16.334 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:51:16.334 INFO:teuthology.orchestra.run.smithi012.stdout:Total 889 kB/s | 255 kB 00:00 2024-04-26T17:51:16.354 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-04-26T17:51:16.547 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-04-26T17:51:16.548 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-04-26T17:51:16.553 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-04-26T17:51:16.553 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-04-26T17:51:16.690 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-04-26T17:51:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:51:16.768 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:17.426 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:17.427 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout:Reinstalled: 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:51:18.122 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-04-26T17:51:18.281 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q kernel | sort -rV | head -n 1 2024-04-26T17:51:18.330 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-26T17:51:18.331 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-26T17:51:18.331 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-26T17:51:18.331 DEBUG:teuthology.parallel:result is None 2024-04-26T17:51:18.332 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T17:51:18.341 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T17:51:18.342 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:51:18.345 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T17:51:18.363 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T17:51:18.372 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T17:51:18.386 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T17:51:18.386 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:51:18.400 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T17:51:18.440 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T17:51:18.448 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T17:51:18.449 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T17:51:18.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:18.491 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:51:18.493 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T17:51:18.538 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:18.557 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:18.572 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:18.597 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T17:51:18.598 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T17:51:18.608 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T17:51:18.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:51:18.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T17:51:18.665 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T17:51:18.675 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T17:51:18.675 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:51:18.678 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T17:51:18.720 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:18.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:18.823 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:18.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:18.944 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:51:18.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:51:19.009 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:19.053 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T17:51:19.101 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:19.187 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T17:51:19.225 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:51:19.225 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T17:51:19.291 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2024-04-26T17:51:19.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-04-26T17:51:19.325 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:51:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T17:51:19.842 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T17:51:19.851 INFO:teuthology.task.internal:Starting timer... 2024-04-26T17:51:19.851 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T17:51:19.862 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T17:51:19.872 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-26T17:51:19.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2024-04-26T17:51:19.940 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: 2024-04-26T17:51:19.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-04-26T17:51:20.017 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-04-26T17:51:20.019 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T17:51:20.019 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2024-04-26T17:51:20.041 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2024-04-26T17:51:20.041 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-04-26T17:51:20.064 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-04-26T17:51:20.065 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive'} 2024-04-26T17:51:20.065 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:51:20.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:20.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T17:51:20.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T17:51:20.133 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T17:51:20.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:51:20.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-04-26T17:51:20.199 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T17:51:20.209 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T17:51:20.229 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T17:51:20.231 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi100.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T17:55:03.204 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com')] 2024-04-26T17:55:03.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-04-26T17:55:03.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:55:03.285 DEBUG:teuthology.orchestra.run.smithi012:> true 2024-04-26T17:55:03.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2024-04-26T17:55:03.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-26T17:55:03.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T17:55:03.443 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-04-26T17:55:03.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-04-26T17:55:03.526 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T17:55:03.536 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T17:55:03.536 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:55:03.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:55:03.539 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T17:55:03.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T17:55:03.569 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:55:03.583 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:55:03.594 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-26T17:55:03.607 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2024-04-26T17:55:03.608 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-26T17:55:03.618 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2024-04-26T17:55:03.630 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-04-26T17:55:03.632 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:55:03.640 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-04-26T17:55:03.646 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:55:03.653 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-26T17:55:03.666 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-26T17:55:03.712 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.716 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.728 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-26T17:55:03.731 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T17:55:03.732 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-26T17:55:03.732 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.732 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.732 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.732 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T17:55:03.733 INFO:teuthology.run_tasks:Running task install... 2024-04-26T17:55:03.742 DEBUG:teuthology.task.install:project ceph 2024-04-26T17:55:03.742 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}} 2024-04-26T17:55:03.742 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'} 2024-04-26T17:55:03.742 INFO:teuthology.task.install:Using flavor: default 2024-04-26T17:55:03.748 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T17:55:03.748 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-26T17:55:03.749 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:55:03.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:55:03.751 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'tag': None, 'wait_for_package': False} 2024-04-26T17:55:03.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:55:03.967 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:55:03.967 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:55:03.983 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/ 2024-04-26T17:55:03.983 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3267.gbc94a2a9 2024-04-26T17:55:04.140 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:55:04.140 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:55:04.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:55:04.149 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer-fixes/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-26T17:55:04.149 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:55:04.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-26T17:55:04.170 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:55:04.170 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:55:04.174 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-26T17:55:04.174 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-26T17:55:04.238 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:55:04.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-26T17:55:04.313 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:55:04.315 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-26T17:55:04.376 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-04-26T17:55:04.377 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-04-26T17:55:04.380 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2024-04-26T17:55:04.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2024-04-26T17:55:04.601 INFO:teuthology.orchestra.run.smithi100.stdout:48 files removed 2024-04-26T17:55:04.618 INFO:teuthology.orchestra.run.smithi012.stdout:48 files removed 2024-04-26T17:55:04.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:55:04.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-26T17:55:05.273 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 217 kB/s | 84 kB 00:00 2024-04-26T17:55:05.340 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 199 kB/s | 84 kB 00:00 2024-04-26T17:55:05.649 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2024-04-26T17:55:05.766 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 31 kB/s | 12 kB 00:00 2024-04-26T17:55:06.000 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-04-26T17:55:06.183 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-26T17:55:06.691 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-04-26T17:55:06.891 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-26T17:55:11.442 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 19 MB 00:03 2024-04-26T17:55:11.959 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 4.8 MB/s | 19 MB 00:04 2024-04-26T17:55:15.542 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-04-26T17:55:16.076 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-26T17:55:17.076 INFO:teuthology.orchestra.run.smithi012.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 16 kB 00:00 2024-04-26T17:55:17.986 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 21 kB/s | 16 kB 00:00 2024-04-26T17:55:36.361 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-26T17:55:37.012 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:18 2024-04-26T17:55:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-26T17:55:42.034 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-26T17:55:43.808 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.809 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.820 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:55:43.821 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:55:43.822 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:55:43.823 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:55:43.824 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:55:43.827 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:55:43.827 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:55:43.892 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2024-04-26T17:55:43.901 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:55:43.902 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:55:43.903 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:55:43.904 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:55:43.905 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:55:43.906 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:55:43.907 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:55:43.908 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:55:43.909 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:55:43.910 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:55:43.911 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:55:43.912 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout:Installing weak dependencies: 2024-04-26T17:55:43.913 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:======================================================================================= 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:Install 148 Packages 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 4 Packages 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:55:43.914 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 222 M 2024-04-26T17:55:43.915 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2024-04-26T17:55:44.151 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:44.152 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-26T17:55:44.162 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-26T17:55:44.163 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-26T17:55:44.164 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-26T17:55:44.165 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-26T17:55:44.166 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-26T17:55:44.169 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-26T17:55:44.169 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-26T17:55:44.229 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 6.6 k 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:44.244 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 890 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 145 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 1.5 M 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 142 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 3.5 M 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 7.4 M 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 49 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 11 M 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 49 M 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 273 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 762 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 224 k 2024-04-26T17:55:44.245 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 27 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 18 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 32 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 746 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 127 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-26T17:55:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 162 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 320 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 298 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 99 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 85 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 170 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.4 M 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 3.1 M 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-04-26T17:55:44.247 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 21 M 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 34 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 2.4 M 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 249 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 4.7 M 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 17 M 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3267.gbc94a2a9.el9 ceph-noarch 16 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 25 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-26T17:55:44.248 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 163 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 501 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-26T17:55:44.249 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 5.4 M 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-26T17:55:44.250 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 45 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-3267.gbc94a2a9.el9 ceph 135 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-26T17:55:44.251 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-26T17:55:44.252 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-26T17:55:44.253 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-26T17:55:44.254 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-26T17:55:44.255 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-04-26T17:55:44.256 INFO:teuthology.orchestra.run.smithi100.stdout:======================================================================================= 2024-04-26T17:55:44.257 INFO:teuthology.orchestra.run.smithi100.stdout:Install 148 Packages 2024-04-26T17:55:44.257 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 4 Packages 2024-04-26T17:55:44.257 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:55:44.257 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 222 M 2024-04-26T17:55:44.257 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-04-26T17:55:44.825 INFO:teuthology.orchestra.run.smithi012.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-04-26T17:55:45.227 INFO:teuthology.orchestra.run.smithi100.stdout:(1/152): ceph-19.0.0-3267.gbc94a2a9.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-04-26T17:55:45.642 INFO:teuthology.orchestra.run.smithi012.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.1 MB/s | 890 kB 00:00 2024-04-26T17:55:45.742 INFO:teuthology.orchestra.run.smithi012.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 1.4 MB/s | 145 kB 00:00 2024-04-26T17:55:46.442 INFO:teuthology.orchestra.run.smithi012.stdout:(4/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x8 2.8 MB/s | 5.4 MB 00:01 2024-04-26T17:55:46.817 INFO:teuthology.orchestra.run.smithi012.stdout:(5/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-04-26T17:55:46.868 INFO:teuthology.orchestra.run.smithi012.stdout:(6/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-04-26T17:55:47.994 INFO:teuthology.orchestra.run.smithi100.stdout:(2/152): ceph-fuse-19.0.0-3267.gbc94a2a9.el9.x8 322 kB/s | 890 kB 00:02 2024-04-26T17:55:48.377 INFO:teuthology.orchestra.run.smithi100.stdout:(3/152): ceph-immutable-object-cache-19.0.0-326 377 kB/s | 145 kB 00:00 2024-04-26T17:55:48.943 INFO:teuthology.orchestra.run.smithi012.stdout:(7/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 2.2 MB/s | 4.7 MB 00:02 2024-04-26T17:55:50.161 INFO:teuthology.orchestra.run.smithi100.stdout:(4/152): ceph-common-19.0.0-3267.gbc94a2a9.el9. 4.1 MB/s | 21 MB 00:05 2024-04-26T17:55:50.436 INFO:teuthology.orchestra.run.smithi100.stdout:(5/152): ceph-mgr-19.0.0-3267.gbc94a2a9.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-04-26T17:55:51.161 INFO:teuthology.orchestra.run.smithi100.stdout:(6/152): ceph-mon-19.0.0-3267.gbc94a2a9.el9.x86 6.5 MB/s | 4.7 MB 00:00 2024-04-26T17:55:51.765 INFO:teuthology.orchestra.run.smithi100.stdout:(7/152): ceph-mds-19.0.0-3267.gbc94a2a9.el9.x86 713 kB/s | 2.4 MB 00:03 2024-04-26T17:55:53.300 INFO:teuthology.orchestra.run.smithi012.stdout:(8/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el9 2.4 MB/s | 11 MB 00:04 2024-04-26T17:55:53.320 INFO:teuthology.orchestra.run.smithi100.stdout:(8/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x86 7.8 MB/s | 17 MB 00:02 2024-04-26T17:55:53.367 INFO:teuthology.orchestra.run.smithi012.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 379 kB/s | 25 kB 00:00 2024-04-26T17:55:53.387 INFO:teuthology.orchestra.run.smithi100.stdout:(9/152): ceph-selinux-19.0.0-3267.gbc94a2a9.el9 378 kB/s | 25 kB 00:00 2024-04-26T17:55:53.462 INFO:teuthology.orchestra.run.smithi100.stdout:(10/152): ceph-base-19.0.0-3267.gbc94a2a9.el9.x 646 kB/s | 5.4 MB 00:08 2024-04-26T17:55:53.737 INFO:teuthology.orchestra.run.smithi100.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 817 kB/s | 224 kB 00:00 2024-04-26T17:55:53.854 INFO:teuthology.orchestra.run.smithi100.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 232 kB/s | 27 kB 00:00 2024-04-26T17:55:53.954 INFO:teuthology.orchestra.run.smithi100.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 318 kB/s | 32 kB 00:00 2024-04-26T17:55:54.075 INFO:teuthology.orchestra.run.smithi012.stdout:(10/152): ceph-osd-19.0.0-3267.gbc94a2a9.el9.x8 2.3 MB/s | 17 MB 00:07 2024-04-26T17:55:54.234 INFO:teuthology.orchestra.run.smithi012.stdout:(11/152): cephfs-mirror-19.0.0-3267.gbc94a2a9.e 1.4 MB/s | 224 kB 00:00 2024-04-26T17:55:54.334 INFO:teuthology.orchestra.run.smithi012.stdout:(12/152): cephfs-shell-19.0.0-3267.gbc94a2a9.el 270 kB/s | 27 kB 00:00 2024-04-26T17:55:54.418 INFO:teuthology.orchestra.run.smithi012.stdout:(13/152): libcephfs-devel-19.0.0-3267.gbc94a2a9 381 kB/s | 32 kB 00:00 2024-04-26T17:55:54.746 INFO:teuthology.orchestra.run.smithi100.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 942 kB/s | 746 kB 00:00 2024-04-26T17:55:54.768 INFO:teuthology.orchestra.run.smithi012.stdout:(14/152): libcephfs2-19.0.0-3267.gbc94a2a9.el9. 2.1 MB/s | 746 kB 00:00 2024-04-26T17:55:54.877 INFO:teuthology.orchestra.run.smithi012.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 1.5 MB/s | 163 kB 00:00 2024-04-26T17:55:54.995 INFO:teuthology.orchestra.run.smithi012.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 1.1 MB/s | 127 kB 00:00 2024-04-26T17:55:55.030 INFO:teuthology.orchestra.run.smithi100.stdout:(15/152): libcephsqlite-19.0.0-3267.gbc94a2a9.e 577 kB/s | 163 kB 00:00 2024-04-26T17:55:55.222 INFO:teuthology.orchestra.run.smithi100.stdout:(16/152): librados-devel-19.0.0-3267.gbc94a2a9. 661 kB/s | 127 kB 00:00 2024-04-26T17:55:55.261 INFO:teuthology.orchestra.run.smithi012.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 1.8 MB/s | 501 kB 00:00 2024-04-26T17:55:55.822 INFO:teuthology.orchestra.run.smithi100.stdout:(17/152): libradosstriper1-19.0.0-3267.gbc94a2a 835 kB/s | 501 kB 00:00 2024-04-26T17:55:57.577 INFO:teuthology.orchestra.run.smithi012.stdout:(18/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 2.3 MB/s | 5.4 MB 00:02 2024-04-26T17:55:57.686 INFO:teuthology.orchestra.run.smithi012.stdout:(19/152): python3-ceph-argparse-19.0.0-3267.gbc 416 kB/s | 45 kB 00:00 2024-04-26T17:55:57.803 INFO:teuthology.orchestra.run.smithi012.stdout:(20/152): python3-ceph-common-19.0.0-3267.gbc94 1.1 MB/s | 135 kB 00:00 2024-04-26T17:55:58.029 INFO:teuthology.orchestra.run.smithi012.stdout:(21/152): ceph-common-19.0.0-3267.gbc94a2a9.el9 1.6 MB/s | 21 MB 00:13 2024-04-26T17:55:58.054 INFO:teuthology.orchestra.run.smithi012.stdout:(22/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 647 kB/s | 162 kB 00:00 2024-04-26T17:55:58.221 INFO:teuthology.orchestra.run.smithi012.stdout:(23/152): python3-rados-19.0.0-3267.gbc94a2a9.e 1.6 MB/s | 320 kB 00:00 2024-04-26T17:55:58.246 INFO:teuthology.orchestra.run.smithi012.stdout:(24/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 1.5 MB/s | 298 kB 00:00 2024-04-26T17:55:58.313 INFO:teuthology.orchestra.run.smithi012.stdout:(25/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.1 MB/s | 99 kB 00:00 2024-04-26T17:55:58.346 INFO:teuthology.orchestra.run.smithi012.stdout:(26/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 850 kB/s | 85 kB 00:00 2024-04-26T17:55:58.838 INFO:teuthology.orchestra.run.smithi012.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 347 kB/s | 170 kB 00:00 2024-04-26T17:55:58.955 INFO:teuthology.orchestra.run.smithi012.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 293 kB/s | 34 kB 00:00 2024-04-26T17:55:59.072 INFO:teuthology.orchestra.run.smithi012.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 1.2 MB/s | 142 kB 00:00 2024-04-26T17:55:59.325 INFO:teuthology.orchestra.run.smithi012.stdout:(30/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 3.1 MB/s | 3.1 MB 00:01 2024-04-26T17:55:59.680 INFO:teuthology.orchestra.run.smithi100.stdout:(18/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 7.8 MB/s | 49 MB 00:06 2024-04-26T17:55:59.839 INFO:teuthology.orchestra.run.smithi100.stdout:(19/152): ceph-radosgw-19.0.0-3267.gbc94a2a9.el 1.3 MB/s | 11 MB 00:08 2024-04-26T17:55:59.864 INFO:teuthology.orchestra.run.smithi100.stdout:(20/152): python3-ceph-argparse-19.0.0-3267.gbc 246 kB/s | 45 kB 00:00 2024-04-26T17:55:59.914 INFO:teuthology.orchestra.run.smithi100.stdout:(21/152): python3-ceph-common-19.0.0-3267.gbc94 1.8 MB/s | 135 kB 00:00 2024-04-26T17:55:59.956 INFO:teuthology.orchestra.run.smithi100.stdout:(22/152): python3-cephfs-19.0.0-3267.gbc94a2a9. 1.7 MB/s | 162 kB 00:00 2024-04-26T17:56:00.023 INFO:teuthology.orchestra.run.smithi100.stdout:(23/152): python3-rados-19.0.0-3267.gbc94a2a9.e 2.9 MB/s | 320 kB 00:00 2024-04-26T17:56:00.048 INFO:teuthology.orchestra.run.smithi100.stdout:(24/152): python3-rbd-19.0.0-3267.gbc94a2a9.el9 3.2 MB/s | 298 kB 00:00 2024-04-26T17:56:00.082 INFO:teuthology.orchestra.run.smithi100.stdout:(25/152): python3-rgw-19.0.0-3267.gbc94a2a9.el9 1.7 MB/s | 99 kB 00:00 2024-04-26T17:56:00.107 INFO:teuthology.orchestra.run.smithi100.stdout:(26/152): rbd-fuse-19.0.0-3267.gbc94a2a9.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-26T17:56:00.166 INFO:teuthology.orchestra.run.smithi100.stdout:(27/152): rbd-nbd-19.0.0-3267.gbc94a2a9.el9.x86 2.9 MB/s | 170 kB 00:00 2024-04-26T17:56:00.206 INFO:teuthology.orchestra.run.smithi012.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 3.1 MB/s | 3.5 MB 00:01 2024-04-26T17:56:00.208 INFO:teuthology.orchestra.run.smithi100.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3267.g 827 kB/s | 34 kB 00:00 2024-04-26T17:56:00.266 INFO:teuthology.orchestra.run.smithi100.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3267.gbc94a2a 2.4 MB/s | 142 kB 00:00 2024-04-26T17:56:00.323 INFO:teuthology.orchestra.run.smithi012.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 2.1 MB/s | 249 kB 00:00 2024-04-26T17:56:00.406 INFO:teuthology.orchestra.run.smithi012.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 591 kB/s | 49 kB 00:00 2024-04-26T17:56:00.490 INFO:teuthology.orchestra.run.smithi012.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3267.gb 198 kB/s | 16 kB 00:00 2024-04-26T17:56:00.559 INFO:teuthology.orchestra.run.smithi100.stdout:(30/152): librgw2-19.0.0-3267.gbc94a2a9.el9.x86 1.1 MB/s | 5.4 MB 00:04 2024-04-26T17:56:00.615 INFO:teuthology.orchestra.run.smithi012.stdout:(35/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 2.1 MB/s | 273 kB 00:00 2024-04-26T17:56:00.809 INFO:teuthology.orchestra.run.smithi100.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3267.gbc94a 6.5 MB/s | 3.5 MB 00:00 2024-04-26T17:56:00.859 INFO:teuthology.orchestra.run.smithi100.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3267.gbc 4.9 MB/s | 249 kB 00:00 2024-04-26T17:56:00.899 INFO:teuthology.orchestra.run.smithi012.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 4.7 MB/s | 7.4 MB 00:01 2024-04-26T17:56:00.909 INFO:teuthology.orchestra.run.smithi100.stdout:(33/152): ceph-mgr-rook-19.0.0-3267.gbc94a2a9.e 989 kB/s | 49 kB 00:00 2024-04-26T17:56:00.933 INFO:teuthology.orchestra.run.smithi012.stdout:(37/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 2.3 MB/s | 762 kB 00:00 2024-04-26T17:56:00.957 INFO:teuthology.orchestra.run.smithi012.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 313 kB/s | 18 kB 00:00 2024-04-26T17:56:00.976 INFO:teuthology.orchestra.run.smithi100.stdout:(34/152): rbd-mirror-19.0.0-3267.gbc94a2a9.el9. 3.5 MB/s | 3.1 MB 00:00 2024-04-26T17:56:00.993 INFO:teuthology.orchestra.run.smithi100.stdout:(35/152): ceph-prometheus-alerts-19.0.0-3267.gb 196 kB/s | 16 kB 00:00 2024-04-26T17:56:01.052 INFO:teuthology.orchestra.run.smithi100.stdout:(36/152): ceph-volume-19.0.0-3267.gbc94a2a9.el9 3.5 MB/s | 273 kB 00:00 2024-04-26T17:56:01.066 INFO:teuthology.orchestra.run.smithi012.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 602 kB/s | 80 kB 00:00 2024-04-26T17:56:01.103 INFO:teuthology.orchestra.run.smithi100.stdout:(37/152): cephadm-19.0.0-3267.gbc94a2a9.el9.noa 6.8 MB/s | 762 kB 00:00 2024-04-26T17:56:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:(38/152): cephfs-top-19.0.0-3267.gbc94a2a9.el9. 242 kB/s | 18 kB 00:00 2024-04-26T17:56:01.150 INFO:teuthology.orchestra.run.smithi012.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-26T17:56:01.195 INFO:teuthology.orchestra.run.smithi100.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 877 kB/s | 80 kB 00:00 2024-04-26T17:56:01.234 INFO:teuthology.orchestra.run.smithi012.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-26T17:56:01.245 INFO:teuthology.orchestra.run.smithi100.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-26T17:56:01.278 INFO:teuthology.orchestra.run.smithi012.stdout:(42/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-04-26T17:56:01.287 INFO:teuthology.orchestra.run.smithi100.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-04-26T17:56:01.337 INFO:teuthology.orchestra.run.smithi100.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-04-26T17:56:01.404 INFO:teuthology.orchestra.run.smithi100.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-26T17:56:01.438 INFO:teuthology.orchestra.run.smithi100.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-26T17:56:01.446 INFO:teuthology.orchestra.run.smithi012.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 639 kB/s | 106 kB 00:00 2024-04-26T17:56:01.497 INFO:teuthology.orchestra.run.smithi100.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-26T17:56:01.511 INFO:teuthology.orchestra.run.smithi012.stdout:(44/152): python3-cryptography-36.0.1-4.el9.x86 4.4 MB/s | 1.2 MB 00:00 2024-04-26T17:56:01.522 INFO:teuthology.orchestra.run.smithi100.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-26T17:56:01.537 INFO:teuthology.orchestra.run.smithi012.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-04-26T17:56:01.562 INFO:teuthology.orchestra.run.smithi012.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-26T17:56:01.589 INFO:teuthology.orchestra.run.smithi100.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-26T17:56:01.621 INFO:teuthology.orchestra.run.smithi012.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-04-26T17:56:01.679 INFO:teuthology.orchestra.run.smithi012.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 5.8 MB/s | 689 kB 00:00 2024-04-26T17:56:01.746 INFO:teuthology.orchestra.run.smithi012.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-04-26T17:56:01.780 INFO:teuthology.orchestra.run.smithi012.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-04-26T17:56:01.781 INFO:teuthology.orchestra.run.smithi100.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-04-26T17:56:01.814 INFO:teuthology.orchestra.run.smithi012.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 321 kB/s | 21 kB 00:00 2024-04-26T17:56:01.839 INFO:teuthology.orchestra.run.smithi100.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-26T17:56:01.864 INFO:teuthology.orchestra.run.smithi012.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-04-26T17:56:01.889 INFO:teuthology.orchestra.run.smithi012.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 436 kB/s | 33 kB 00:00 2024-04-26T17:56:01.889 INFO:teuthology.orchestra.run.smithi100.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-26T17:56:01.915 INFO:teuthology.orchestra.run.smithi100.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-04-26T17:56:01.939 INFO:teuthology.orchestra.run.smithi012.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-26T17:56:01.965 INFO:teuthology.orchestra.run.smithi100.stdout:(52/152): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-04-26T17:56:01.981 INFO:teuthology.orchestra.run.smithi012.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-04-26T17:56:01.990 INFO:teuthology.orchestra.run.smithi100.stdout:(53/152): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-04-26T17:56:02.041 INFO:teuthology.orchestra.run.smithi100.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-04-26T17:56:02.073 INFO:teuthology.orchestra.run.smithi012.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-26T17:56:02.091 INFO:teuthology.orchestra.run.smithi100.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-26T17:56:02.098 INFO:teuthology.orchestra.run.smithi012.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-04-26T17:56:02.149 INFO:teuthology.orchestra.run.smithi012.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-04-26T17:56:02.149 INFO:teuthology.orchestra.run.smithi100.stdout:(56/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-26T17:56:02.217 INFO:teuthology.orchestra.run.smithi100.stdout:(57/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-04-26T17:56:02.224 INFO:teuthology.orchestra.run.smithi012.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-04-26T17:56:02.257 INFO:teuthology.orchestra.run.smithi012.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-04-26T17:56:02.300 INFO:teuthology.orchestra.run.smithi012.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 339 kB/s | 25 kB 00:00 2024-04-26T17:56:02.325 INFO:teuthology.orchestra.run.smithi012.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-04-26T17:56:02.392 INFO:teuthology.orchestra.run.smithi012.stdout:(63/152): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-04-26T17:56:02.417 INFO:teuthology.orchestra.run.smithi012.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-26T17:56:02.434 INFO:teuthology.orchestra.run.smithi100.stdout:(58/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-04-26T17:56:02.460 INFO:teuthology.orchestra.run.smithi012.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-04-26T17:56:02.667 INFO:teuthology.orchestra.run.smithi100.stdout:(59/152): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-04-26T17:56:02.734 INFO:teuthology.orchestra.run.smithi100.stdout:(60/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 383 kB/s | 25 kB 00:00 2024-04-26T17:56:02.809 INFO:teuthology.orchestra.run.smithi100.stdout:(61/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-04-26T17:56:02.860 INFO:teuthology.orchestra.run.smithi012.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-04-26T17:56:02.968 INFO:teuthology.orchestra.run.smithi100.stdout:(62/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-04-26T17:56:03.010 INFO:teuthology.orchestra.run.smithi012.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.0 MB/s | 4.4 MB 00:00 2024-04-26T17:56:03.018 INFO:teuthology.orchestra.run.smithi100.stdout:(63/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-04-26T17:56:03.052 INFO:teuthology.orchestra.run.smithi012.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-04-26T17:56:03.071 INFO:teuthology.orchestra.run.smithi100.stdout:(64/152): openblas-0.3.21-2.el9.x86_64.rpm 677 kB/s | 35 kB 00:00 2024-04-26T17:56:03.096 INFO:teuthology.orchestra.run.smithi100.stdout:(65/152): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-26T17:56:03.127 INFO:teuthology.orchestra.run.smithi012.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 1.7 MB/s | 133 kB 00:00 2024-04-26T17:56:03.178 INFO:teuthology.orchestra.run.smithi012.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-04-26T17:56:03.411 INFO:teuthology.orchestra.run.smithi012.stdout:(71/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-04-26T17:56:03.461 INFO:teuthology.orchestra.run.smithi012.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-04-26T17:56:03.578 INFO:teuthology.orchestra.run.smithi012.stdout:(73/152): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-04-26T17:56:03.687 INFO:teuthology.orchestra.run.smithi012.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-04-26T17:56:03.762 INFO:teuthology.orchestra.run.smithi012.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-04-26T17:56:03.805 INFO:teuthology.orchestra.run.smithi100.stdout:(66/152): ceph-mgr-diskprediction-local-19.0.0- 2.3 MB/s | 7.4 MB 00:03 2024-04-26T17:56:03.846 INFO:teuthology.orchestra.run.smithi012.stdout:(76/152): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-04-26T17:56:03.871 INFO:teuthology.orchestra.run.smithi012.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 236 kB/s | 26 kB 00:00 2024-04-26T17:56:03.905 INFO:teuthology.orchestra.run.smithi012.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-04-26T17:56:03.955 INFO:teuthology.orchestra.run.smithi012.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-04-26T17:56:03.972 INFO:teuthology.orchestra.run.smithi012.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 519 kB/s | 35 kB 00:00 2024-04-26T17:56:04.047 INFO:teuthology.orchestra.run.smithi012.stdout:(81/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-04-26T17:56:04.131 INFO:teuthology.orchestra.run.smithi012.stdout:(82/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-04-26T17:56:04.189 INFO:teuthology.orchestra.run.smithi100.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 4.2 MB/s | 4.7 MB 00:01 2024-04-26T17:56:04.239 INFO:teuthology.orchestra.run.smithi012.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-04-26T17:56:04.265 INFO:teuthology.orchestra.run.smithi012.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 578 kB/s | 77 kB 00:00 2024-04-26T17:56:04.280 INFO:teuthology.orchestra.run.smithi100.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-04-26T17:56:04.315 INFO:teuthology.orchestra.run.smithi012.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 562 kB/s | 42 kB 00:00 2024-04-26T17:56:04.339 INFO:teuthology.orchestra.run.smithi100.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-04-26T17:56:04.365 INFO:teuthology.orchestra.run.smithi012.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-04-26T17:56:04.398 INFO:teuthology.orchestra.run.smithi100.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.3 MB/s | 911 kB 00:00 2024-04-26T17:56:04.474 INFO:teuthology.orchestra.run.smithi012.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-26T17:56:04.489 INFO:teuthology.orchestra.run.smithi100.stdout:(71/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-04-26T17:56:04.548 INFO:teuthology.orchestra.run.smithi100.stdout:(72/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-26T17:56:04.674 INFO:teuthology.orchestra.run.smithi100.stdout:(73/152): protobuf-3.14.0-13.el9.x86_64.rpm 3.7 MB/s | 1.0 MB 00:00 2024-04-26T17:56:04.757 INFO:teuthology.orchestra.run.smithi100.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-04-26T17:56:04.841 INFO:teuthology.orchestra.run.smithi100.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-26T17:56:04.899 INFO:teuthology.orchestra.run.smithi100.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-04-26T17:56:04.908 INFO:teuthology.orchestra.run.smithi012.stdout:(88/152): ceph-test-19.0.0-3267.gbc94a2a9.el9.x 4.3 MB/s | 49 MB 00:11 2024-04-26T17:56:04.958 INFO:teuthology.orchestra.run.smithi012.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 471 kB/s | 279 kB 00:00 2024-04-26T17:56:04.959 INFO:teuthology.orchestra.run.smithi100.stdout:(77/152): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-04-26T17:56:04.983 INFO:teuthology.orchestra.run.smithi012.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 100 kB/s | 51 kB 00:00 2024-04-26T17:56:05.008 INFO:teuthology.orchestra.run.smithi012.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 536 kB/s | 54 kB 00:00 2024-04-26T17:56:05.050 INFO:teuthology.orchestra.run.smithi100.stdout:(78/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-26T17:56:05.058 INFO:teuthology.orchestra.run.smithi012.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-04-26T17:56:05.084 INFO:teuthology.orchestra.run.smithi012.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 588 kB/s | 44 kB 00:00 2024-04-26T17:56:05.108 INFO:teuthology.orchestra.run.smithi100.stdout:(79/152): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-04-26T17:56:05.134 INFO:teuthology.orchestra.run.smithi012.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 721 kB/s | 36 kB 00:00 2024-04-26T17:56:05.159 INFO:teuthology.orchestra.run.smithi012.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-26T17:56:05.218 INFO:teuthology.orchestra.run.smithi012.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-04-26T17:56:05.269 INFO:teuthology.orchestra.run.smithi012.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 2.7 MB/s | 305 kB 00:00 2024-04-26T17:56:05.302 INFO:teuthology.orchestra.run.smithi012.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 690 kB/s | 58 kB 00:00 2024-04-26T17:56:05.361 INFO:teuthology.orchestra.run.smithi012.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-04-26T17:56:05.386 INFO:teuthology.orchestra.run.smithi012.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-04-26T17:56:05.454 INFO:teuthology.orchestra.run.smithi012.stdout:(101/152): lua-devel-5.4.4-4.el9.x86_64.rpm 332 kB/s | 22 kB 00:00 2024-04-26T17:56:05.478 INFO:teuthology.orchestra.run.smithi012.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 382 kB/s | 45 kB 00:00 2024-04-26T17:56:05.592 INFO:teuthology.orchestra.run.smithi100.stdout:(80/152): postgresql-server-13.14-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-04-26T17:56:05.679 INFO:teuthology.orchestra.run.smithi012.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-26T17:56:05.726 INFO:teuthology.orchestra.run.smithi100.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-04-26T17:56:05.738 INFO:teuthology.orchestra.run.smithi012.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-04-26T17:56:05.751 INFO:teuthology.orchestra.run.smithi100.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-04-26T17:56:05.785 INFO:teuthology.orchestra.run.smithi100.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-26T17:56:05.810 INFO:teuthology.orchestra.run.smithi100.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-26T17:56:05.835 INFO:teuthology.orchestra.run.smithi100.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-26T17:56:05.854 INFO:teuthology.orchestra.run.smithi012.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 167 kB/s | 19 kB 00:00 2024-04-26T17:56:05.894 INFO:teuthology.orchestra.run.smithi100.stdout:(86/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-04-26T17:56:05.919 INFO:teuthology.orchestra.run.smithi100.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-04-26T17:56:05.946 INFO:teuthology.orchestra.run.smithi012.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.1 MB/s | 309 kB 00:00 2024-04-26T17:56:05.969 INFO:teuthology.orchestra.run.smithi100.stdout:(88/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-26T17:56:05.988 INFO:teuthology.orchestra.run.smithi012.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-04-26T17:56:05.994 INFO:teuthology.orchestra.run.smithi100.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-04-26T17:56:06.013 INFO:teuthology.orchestra.run.smithi012.stdout:(108/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-04-26T17:56:06.028 INFO:teuthology.orchestra.run.smithi100.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 920 kB/s | 54 kB 00:00 2024-04-26T17:56:06.038 INFO:teuthology.orchestra.run.smithi012.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-04-26T17:56:06.087 INFO:teuthology.orchestra.run.smithi100.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-26T17:56:06.089 INFO:teuthology.orchestra.run.smithi012.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 897 kB/s | 67 kB 00:00 2024-04-26T17:56:06.114 INFO:teuthology.orchestra.run.smithi012.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-04-26T17:56:06.179 INFO:teuthology.orchestra.run.smithi100.stdout:(92/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.8 MB/s | 5.1 MB 00:01 2024-04-26T17:56:06.204 INFO:teuthology.orchestra.run.smithi100.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 377 kB/s | 44 kB 00:00 2024-04-26T17:56:06.223 INFO:teuthology.orchestra.run.smithi012.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-04-26T17:56:06.248 INFO:teuthology.orchestra.run.smithi012.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-04-26T17:56:06.263 INFO:teuthology.orchestra.run.smithi100.stdout:(94/152): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-04-26T17:56:06.273 INFO:teuthology.orchestra.run.smithi012.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-04-26T17:56:06.280 INFO:teuthology.orchestra.run.smithi100.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-26T17:56:06.298 INFO:teuthology.orchestra.run.smithi012.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-04-26T17:56:06.322 INFO:teuthology.orchestra.run.smithi100.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-26T17:56:06.324 INFO:teuthology.orchestra.run.smithi012.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-04-26T17:56:06.366 INFO:teuthology.orchestra.run.smithi012.stdout:(117/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.0 MB/s | 839 kB 00:00 2024-04-26T17:56:06.380 INFO:teuthology.orchestra.run.smithi100.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-26T17:56:06.391 INFO:teuthology.orchestra.run.smithi012.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-04-26T17:56:06.397 INFO:teuthology.orchestra.run.smithi100.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 766 kB/s | 58 kB 00:00 2024-04-26T17:56:06.416 INFO:teuthology.orchestra.run.smithi012.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-26T17:56:06.439 INFO:teuthology.orchestra.run.smithi100.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-26T17:56:06.442 INFO:teuthology.orchestra.run.smithi012.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 703 kB/s | 35 kB 00:00 2024-04-26T17:56:06.475 INFO:teuthology.orchestra.run.smithi012.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 3.4 MB/s | 206 kB 00:00 2024-04-26T17:56:06.481 INFO:teuthology.orchestra.run.smithi100.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-04-26T17:56:06.498 INFO:teuthology.orchestra.run.smithi100.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-04-26T17:56:06.500 INFO:teuthology.orchestra.run.smithi012.stdout:(122/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-04-26T17:56:06.532 INFO:teuthology.orchestra.run.smithi100.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 445 kB/s | 22 kB 00:00 2024-04-26T17:56:06.534 INFO:teuthology.orchestra.run.smithi012.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-04-26T17:56:06.576 INFO:teuthology.orchestra.run.smithi012.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2024-04-26T17:56:06.601 INFO:teuthology.orchestra.run.smithi012.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 265 kB/s | 18 kB 00:00 2024-04-26T17:56:06.626 INFO:teuthology.orchestra.run.smithi012.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-04-26T17:56:06.677 INFO:teuthology.orchestra.run.smithi012.stdout:(127/152): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-04-26T17:56:06.682 INFO:teuthology.orchestra.run.smithi100.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 4.6 MB/s | 863 kB 00:00 2024-04-26T17:56:06.702 INFO:teuthology.orchestra.run.smithi012.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 193 kB/s | 19 kB 00:00 2024-04-26T17:56:06.727 INFO:teuthology.orchestra.run.smithi012.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-04-26T17:56:06.761 INFO:teuthology.orchestra.run.smithi012.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-26T17:56:06.786 INFO:teuthology.orchestra.run.smithi012.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-26T17:56:06.811 INFO:teuthology.orchestra.run.smithi012.stdout:(132/152): python3-logutils-0.3.5-21.el9.noarch 554 kB/s | 46 kB 00:00 2024-04-26T17:56:06.837 INFO:teuthology.orchestra.run.smithi012.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 764 kB/s | 58 kB 00:00 2024-04-26T17:56:06.862 INFO:teuthology.orchestra.run.smithi012.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-26T17:56:06.887 INFO:teuthology.orchestra.run.smithi012.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-26T17:56:06.913 INFO:teuthology.orchestra.run.smithi012.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-26T17:56:06.938 INFO:teuthology.orchestra.run.smithi012.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-04-26T17:56:06.963 INFO:teuthology.orchestra.run.smithi012.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-04-26T17:56:06.988 INFO:teuthology.orchestra.run.smithi012.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-26T17:56:07.014 INFO:teuthology.orchestra.run.smithi012.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 784 kB/s | 59 kB 00:00 2024-04-26T17:56:07.039 INFO:teuthology.orchestra.run.smithi012.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-04-26T17:56:07.064 INFO:teuthology.orchestra.run.smithi012.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-26T17:56:07.089 INFO:teuthology.orchestra.run.smithi012.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-26T17:56:07.115 INFO:teuthology.orchestra.run.smithi012.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-26T17:56:07.124 INFO:teuthology.orchestra.run.smithi100.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 926 kB/s | 548 kB 00:00 2024-04-26T17:56:07.149 INFO:teuthology.orchestra.run.smithi012.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-26T17:56:07.174 INFO:teuthology.orchestra.run.smithi012.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-04-26T17:56:07.182 INFO:teuthology.orchestra.run.smithi100.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 618 kB/s | 309 kB 00:00 2024-04-26T17:56:07.207 INFO:teuthology.orchestra.run.smithi012.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-04-26T17:56:07.241 INFO:teuthology.orchestra.run.smithi012.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-04-26T17:56:07.391 INFO:teuthology.orchestra.run.smithi100.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-04-26T17:56:07.591 INFO:teuthology.orchestra.run.smithi012.stdout:(149/152): librados2-19.0.0-3267.gbc94a2a9.el9. 8.1 MB/s | 3.4 MB 00:00 2024-04-26T17:56:07.625 INFO:teuthology.orchestra.run.smithi012.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 3.5 MB/s | 1.3 MB 00:00 2024-04-26T17:56:07.650 INFO:teuthology.orchestra.run.smithi100.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 101 kB/s | 26 kB 00:00 2024-04-26T17:56:07.909 INFO:teuthology.orchestra.run.smithi100.stdout:(108/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.5 MB/s | 16 MB 00:01 2024-04-26T17:56:07.966 INFO:teuthology.orchestra.run.smithi012.stdout:(151/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 4.1 MB/s | 3.1 MB 00:00 2024-04-26T17:56:08.009 INFO:teuthology.orchestra.run.smithi100.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-04-26T17:56:08.258 INFO:teuthology.orchestra.run.smithi012.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-04-26T17:56:08.262 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:56:08.262 INFO:teuthology.orchestra.run.smithi012.stdout:Total 9.1 MB/s | 222 MB 00:24 2024-04-26T17:56:08.267 INFO:teuthology.orchestra.run.smithi100.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 188 kB/s | 67 kB 00:00 2024-04-26T17:56:08.518 INFO:teuthology.orchestra.run.smithi100.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 297 kB/s | 151 kB 00:00 2024-04-26T17:56:08.576 INFO:teuthology.orchestra.run.smithi100.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-04-26T17:56:08.918 INFO:teuthology.orchestra.run.smithi100.stdout:(113/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-04-26T17:56:08.943 INFO:teuthology.orchestra.run.smithi100.stdout:(114/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.2 MB/s | 839 kB 00:00 2024-04-26T17:56:09.102 INFO:teuthology.orchestra.run.smithi100.stdout:(115/152): python3-asyncssh-2.13.2-5.el9.noarch 938 kB/s | 548 kB 00:00 2024-04-26T17:56:09.177 INFO:teuthology.orchestra.run.smithi100.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 124 kB/s | 32 kB 00:00 2024-04-26T17:56:09.211 INFO:teuthology.orchestra.run.smithi100.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 56 kB/s | 15 kB 00:00 2024-04-26T17:56:09.400 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2024-04-26T17:56:09.561 INFO:teuthology.orchestra.run.smithi100.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 374 kB/s | 172 kB 00:00 2024-04-26T17:56:09.562 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2024-04-26T17:56:09.562 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2024-04-26T17:56:09.686 INFO:teuthology.orchestra.run.smithi100.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 704 kB/s | 358 kB 00:00 2024-04-26T17:56:09.720 INFO:teuthology.orchestra.run.smithi100.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 596 kB/s | 303 kB 00:00 2024-04-26T17:56:09.822 INFO:teuthology.orchestra.run.smithi100.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 136 kB/s | 35 kB 00:00 2024-04-26T17:56:10.196 INFO:teuthology.orchestra.run.smithi100.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 404 kB/s | 206 kB 00:00 2024-04-26T17:56:10.246 INFO:teuthology.orchestra.run.smithi100.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 340 kB/s | 144 kB 00:00 2024-04-26T17:56:10.405 INFO:teuthology.orchestra.run.smithi100.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 51 kB/s | 11 kB 00:00 2024-04-26T17:56:10.513 INFO:teuthology.orchestra.run.smithi100.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 66 kB/s | 18 kB 00:00 2024-04-26T17:56:10.597 INFO:teuthology.orchestra.run.smithi100.stdout:(126/152): python3-grpcio-1.46.7-10.el9.x86_64. 2.3 MB/s | 2.0 MB 00:00 2024-04-26T17:56:10.664 INFO:teuthology.orchestra.run.smithi100.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 89 kB/s | 23 kB 00:00 2024-04-26T17:56:10.781 INFO:teuthology.orchestra.run.smithi100.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 73 kB/s | 19 kB 00:00 2024-04-26T17:56:10.864 INFO:teuthology.orchestra.run.smithi100.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 74 kB/s | 20 kB 00:00 2024-04-26T17:56:11.139 INFO:teuthology.orchestra.run.smithi100.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 129 kB/s | 46 kB 00:00 2024-04-26T17:56:11.323 INFO:teuthology.orchestra.run.smithi100.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 172 kB/s | 79 kB 00:00 2024-04-26T17:56:11.357 INFO:teuthology.orchestra.run.smithi100.stdout:(132/152): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-04-26T17:56:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2024-04-26T17:56:11.444 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2024-04-26T17:56:11.607 INFO:teuthology.orchestra.run.smithi100.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 123 kB/s | 58 kB 00:00 2024-04-26T17:56:11.632 INFO:teuthology.orchestra.run.smithi100.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 60 kB/s | 16 kB 00:00 2024-04-26T17:56:11.832 INFO:teuthology.orchestra.run.smithi100.stdout:(135/152): python3-pecan-1.4.2-3.el9.noarch.rpm 535 kB/s | 272 kB 00:00 2024-04-26T17:56:11.899 INFO:teuthology.orchestra.run.smithi100.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 106 kB/s | 28 kB 00:00 2024-04-26T17:56:11.950 INFO:teuthology.orchestra.run.smithi100.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 263 kB/s | 90 kB 00:00 2024-04-26T17:56:12.092 INFO:teuthology.orchestra.run.smithi100.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2024-04-26T17:56:12.325 INFO:teuthology.orchestra.run.smithi100.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 443 kB/s | 188 kB 00:00 2024-04-26T17:56:12.367 INFO:teuthology.orchestra.run.smithi100.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 130 kB/s | 36 kB 00:00 2024-04-26T17:56:12.384 INFO:teuthology.orchestra.run.smithi100.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 136 kB/s | 59 kB 00:00 2024-04-26T17:56:12.667 INFO:teuthology.orchestra.run.smithi100.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 149 kB/s | 51 kB 00:00 2024-04-26T17:56:12.726 INFO:teuthology.orchestra.run.smithi100.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 262 kB/s | 90 kB 00:00 2024-04-26T17:56:12.876 INFO:teuthology.orchestra.run.smithi100.stdout:(144/152): python3-webob-1.8.7-6.el9.noarch.rpm 451 kB/s | 230 kB 00:00 2024-04-26T17:56:12.993 INFO:teuthology.orchestra.run.smithi100.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 75 kB/s | 20 kB 00:00 2024-04-26T17:56:13.252 INFO:teuthology.orchestra.run.smithi100.stdout:(146/152): python3-werkzeug-2.0.3-3.el9.1.noarc 731 kB/s | 427 kB 00:00 2024-04-26T17:56:13.386 INFO:teuthology.orchestra.run.smithi100.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 376 kB/s | 192 kB 00:00 2024-04-26T17:56:13.844 INFO:teuthology.orchestra.run.smithi100.stdout:(148/152): librados2-19.0.0-3267.gbc94a2a9.el9. 5.7 MB/s | 3.4 MB 00:00 2024-04-26T17:56:13.886 INFO:teuthology.orchestra.run.smithi100.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2024-04-26T17:56:13.987 INFO:teuthology.orchestra.run.smithi100.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 9.5 MB/s | 1.3 MB 00:00 2024-04-26T17:56:14.037 INFO:teuthology.orchestra.run.smithi100.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-04-26T17:56:14.454 INFO:teuthology.orchestra.run.smithi100.stdout:(152/152): librbd1-19.0.0-3267.gbc94a2a9.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-04-26T17:56:14.457 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-04-26T17:56:14.457 INFO:teuthology.orchestra.run.smithi100.stdout:Total 7.3 MB/s | 222 MB 00:30 2024-04-26T17:56:15.565 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-04-26T17:56:15.709 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-04-26T17:56:15.709 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-04-26T17:56:17.496 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2024-04-26T17:56:17.609 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-04-26T17:56:17.610 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-04-26T17:56:17.620 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:56:17.819 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:56:17.875 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:56:17.914 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:56:17.939 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:56:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:56:18.328 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:56:18.447 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:18.572 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:18.598 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:18.682 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:18.711 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:56:18.867 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:56:18.917 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:56:18.944 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:19.050 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:19.078 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:19.125 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:19.146 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:19.169 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:19.364 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:19.396 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:19.507 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:56:19.602 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:56:19.637 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:56:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:56:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:56:19.788 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:56:19.832 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:56:19.864 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:56:19.891 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:56:19.963 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:56:20.014 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:56:20.044 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:56:20.080 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:56:20.159 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:56:20.190 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:56:20.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:56:20.262 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:56:20.335 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:56:20.378 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:56:20.455 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:56:20.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:56:20.664 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:56:21.219 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:56:21.302 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:56:21.337 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:56:21.381 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:56:21.418 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:56:21.460 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:56:21.612 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:56:21.663 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:56:21.719 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:56:21.794 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:56:21.830 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:56:21.867 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:56:21.915 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:56:21.950 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:56:22.001 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:56:22.043 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:56:22.187 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:56:22.232 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:56:22.262 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:56:22.305 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:56:22.401 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:56:22.437 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:56:22.477 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:56:22.510 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:56:22.535 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:56:22.613 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:56:22.744 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:56:22.776 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:56:22.804 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:56:22.847 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:56:22.886 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:56:22.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:56:22.956 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:56:22.990 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:56:23.015 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:56:23.059 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:56:23.091 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:56:23.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:56:23.231 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:56:23.262 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:56:23.310 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:56:23.420 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:56:23.480 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:56:23.602 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-04-26T17:56:23.682 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-26T17:56:23.729 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-26T17:56:23.783 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-26T17:56:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-26T17:56:23.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-26T17:56:23.884 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-26T17:56:24.206 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-26T17:56:24.245 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:56:24.285 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:56:24.319 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:56:24.326 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:24.421 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:56:24.447 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:56:24.469 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:56:24.478 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:24.558 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:56:24.568 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:56:24.595 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:56:24.598 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:56:24.750 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-26T17:56:24.781 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:56:24.795 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-26T17:56:24.818 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:56:24.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:24.899 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:56:24.918 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:56:24.941 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:25.004 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 14/156 2024-04-26T17:56:25.025 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:25.051 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-26T17:56:25.251 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:25.284 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-26T17:56:25.391 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-26T17:56:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-04-26T17:56:25.533 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-26T17:56:25.567 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-26T17:56:25.632 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-26T17:56:25.666 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-26T17:56:25.709 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-26T17:56:25.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-26T17:56:25.770 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-26T17:56:25.791 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:56:25.839 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-26T17:56:25.893 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-26T17:56:25.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:56:25.923 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-26T17:56:25.958 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-26T17:56:26.035 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-26T17:56:26.070 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 31/156 2024-04-26T17:56:26.113 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 32/156 2024-04-26T17:56:26.133 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 33/156 2024-04-26T17:56:26.204 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-26T17:56:26.248 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-26T17:56:26.322 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-26T17:56:26.458 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-26T17:56:26.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-26T17:56:27.045 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-26T17:56:27.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-26T17:56:27.192 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-26T17:56:27.204 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:56:27.234 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-26T17:56:27.273 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 43/156 2024-04-26T17:56:27.280 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:56:27.308 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:56:27.314 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-26T17:56:27.341 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:56:27.478 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-26T17:56:27.534 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-26T17:56:27.589 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-26T17:56:27.663 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-26T17:56:27.670 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:56:27.693 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-26T17:56:27.730 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-26T17:56:27.737 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:27.777 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-26T17:56:27.813 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-26T17:56:27.828 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:27.856 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-26T17:56:27.859 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:56:27.895 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:56:27.898 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-26T17:56:28.036 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-26T17:56:28.078 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-26T17:56:28.108 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-26T17:56:28.150 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-26T17:56:28.246 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-26T17:56:28.275 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-26T17:56:28.315 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-26T17:56:28.341 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-26T17:56:28.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-04-26T17:56:28.401 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:56:28.432 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:28.441 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-26T17:56:28.525 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:28.550 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:56:28.577 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-26T17:56:28.615 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-26T17:56:28.643 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-26T17:56:28.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-26T17:56:28.716 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-26T17:56:28.748 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-26T17:56:28.786 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-26T17:56:28.820 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-26T17:56:28.854 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-26T17:56:28.887 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-26T17:56:28.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-26T17:56:29.010 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-26T17:56:29.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-26T17:56:29.083 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-26T17:56:29.130 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-26T17:56:29.230 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-26T17:56:29.293 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-26T17:56:30.031 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-26T17:56:30.073 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-26T17:56:30.107 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-26T17:56:30.209 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-26T17:56:30.265 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-26T17:56:30.354 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-26T17:56:30.384 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-26T17:56:30.570 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-26T17:56:30.599 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-26T17:56:30.676 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-26T17:56:30.959 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:30.997 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:31.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-26T17:56:31.449 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-26T17:56:31.568 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:31.617 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:31.709 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:56:31.709 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:56:31.709 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:31.743 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:32.687 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-26T17:56:32.762 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-26T17:56:32.790 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-26T17:56:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-26T17:56:33.135 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-26T17:56:33.177 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:33.268 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 99/156 2024-04-26T17:56:33.300 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 100/156 2024-04-26T17:56:33.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-26T17:56:33.821 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-04-26T17:56:33.847 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:33.901 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 103/156 2024-04-26T17:56:33.923 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 104/156 2024-04-26T17:56:36.238 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:36.271 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:36.817 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 105/156 2024-04-26T17:56:36.858 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:36.949 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 106/156 2024-04-26T17:56:36.949 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-26T17:56:36.949 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-26T17:56:36.949 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:36.976 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:43.795 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:43.795 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2024-04-26T17:56:43.795 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2024-04-26T17:56:43.795 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2024-04-26T17:56:43.796 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2024-04-26T17:56:43.796 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2024-04-26T17:56:43.796 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /root 2024-04-26T17:56:43.796 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2024-04-26T17:56:43.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:43.980 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:43.997 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:43.997 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:56:43.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:45.533 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:45.560 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:45.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:45.792 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:45.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:46.276 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:46.299 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:46.300 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:46.407 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:56:46.464 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:56:46.528 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:56:46.722 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:56:46.777 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:56:46.857 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:56:46.948 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:56:47.090 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:56:47.128 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:56:47.159 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:56:47.186 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:56:47.648 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:47.677 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:47.710 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:56:47.773 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:56:47.799 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:48.604 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 107/156 2024-04-26T17:56:48.604 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-04-26T17:56:48.604 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-04-26T17:56:48.605 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:48.772 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:48.787 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 108/156 2024-04-26T17:56:48.787 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:48.787 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-26T17:56:48.788 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:48.897 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:48.926 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:49.943 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:49.969 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:50.078 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:50.246 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:56:50.257 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:50.270 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 109/156 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-26T17:56:50.284 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:50.294 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:50.295 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:50.295 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:56:50.295 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:50.295 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:50.295 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:50.346 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:50.357 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:50.450 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:56:50.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:56:50.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 110/156 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-26T17:56:50.532 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:50.985 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 111/156 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-26T17:56:51.008 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:51.116 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-26T17:56:51.173 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-26T17:56:51.228 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-26T17:56:51.416 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-26T17:56:51.469 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-26T17:56:51.490 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:56:51.543 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:51.548 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:51.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:51.607 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:51.631 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:51.631 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:56:51.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:51.644 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:56:51.683 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:51.706 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:51.707 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:51.707 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:56:51.707 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:51.707 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:51.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:51.785 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:56:51.828 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-26T17:56:51.860 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-26T17:56:51.888 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-26T17:56:52.025 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:52.049 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:56:52.322 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:52.344 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 123/156 2024-04-26T17:56:52.368 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 124/156 2024-04-26T17:56:52.430 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 125/156 2024-04-26T17:56:52.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:53.496 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 126/156 2024-04-26T17:56:53.537 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:54.503 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 127/156 2024-04-26T17:56:54.545 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:54.649 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 128/156 2024-04-26T17:56:54.823 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 129/156 2024-04-26T17:56:54.855 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:54.878 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 130/156 2024-04-26T17:56:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-26T17:56:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:54.878 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-26T17:56:54.879 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:54.923 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:54.934 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 131/156 2024-04-26T17:56:55.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 132/156 2024-04-26T17:56:55.079 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 133/156 2024-04-26T17:56:56.004 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-26T17:56:56.033 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:56.056 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 135/156 2024-04-26T17:56:56.056 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:56.056 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-26T17:56:56.056 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:56.057 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-26T17:56:56.057 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:56.101 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:56.123 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 136/156 2024-04-26T17:56:56.123 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:56.123 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-26T17:56:56.123 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:56.168 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:56.190 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 137/156 2024-04-26T17:56:56.190 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:56.190 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-26T17:56:56.191 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:56.191 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-26T17:56:56.191 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:56.494 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 138/156 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-26T17:56:56.518 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:56:56.912 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:56:56.954 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:56:56.995 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:56:57.026 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:56:57.053 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:56:57.250 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:56:57.299 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:56:57.329 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:56:57.947 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:57.985 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:58.005 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:56:58.909 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:56:59.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:56:59.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:56:59.133 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:56:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:56:59.169 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:59.253 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:56:59.286 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:56:59.287 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:59.378 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:56:59.447 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:01.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 139/156 2024-04-26T17:57:01.147 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 140/156 2024-04-26T17:57:01.188 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 141/156 2024-04-26T17:57:01.220 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-26T17:57:01.247 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-26T17:57:01.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 144/156 2024-04-26T17:57:01.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-26T17:57:01.515 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 146/156 2024-04-26T17:57:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:57:02.171 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:57:02.192 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-26T17:57:03.030 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 148/156 2024-04-26T17:57:03.102 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-26T17:57:03.143 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-26T17:57:03.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-26T17:57:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-26T17:57:03.281 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:57:03.365 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-26T17:57:03.406 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:57:03.407 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:57:03.501 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-26T17:57:03.572 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:57:05.136 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:57:05.137 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:57:05.137 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:57:05.137 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:57:05.137 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:57:05.137 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:57:05.138 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:57:05.139 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:57:05.140 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:57:05.140 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:57:05.140 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:57:05.140 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:57:05.140 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:57:05.141 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:57:05.142 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:57:05.143 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:57:05.144 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:57:05.145 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:57:05.146 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:57:05.147 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:57:05.148 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:57:05.149 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:57:05.150 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:57:07.380 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:07.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:07.380 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2024-04-26T17:57:07.380 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.380 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:57:07.381 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.382 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.383 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.383 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.383 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.383 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.383 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.384 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:57:07.385 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.386 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:57:07.387 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:57:07.387 INFO:teuthology.orchestra.run.smithi012.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:57:07.387 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:57:07.387 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:57:07.387 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:57:07.388 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:57:07.389 INFO:teuthology.orchestra.run.smithi012.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:57:07.390 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:57:07.391 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:57:07.392 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:57:07.393 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:57:07.394 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:57:07.395 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:57:07.396 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:57:07.397 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:57:07.398 INFO:teuthology.orchestra.run.smithi012.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:57:07.398 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:57:07.398 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:57:07.399 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:57:07.399 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:07.399 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2024-04-26T17:57:07.765 DEBUG:teuthology.parallel:result is None 2024-04-26T17:57:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 1/156 2024-04-26T17:57:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2/156 2024-04-26T17:57:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 3/156 2024-04-26T17:57:09.280 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 4/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3267.gbc94a 5/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 6/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 7/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 8/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 9/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 10/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 11/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 12/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 13/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 14/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_ 15/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 16/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 17/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_6 18/156 2024-04-26T17:57:09.281 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86 19/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 20/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el 21/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9. 22/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_6 23/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 24/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 25/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 26/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 27/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 28/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 29/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9. 30/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noa 31/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.n 32/156 2024-04-26T17:57:09.282 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc9 33/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el 34/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 35/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.e 36/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 37/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 38/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 39/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-26T17:57:09.283 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-26T17:57:09.284 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-26T17:57:09.285 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-26T17:57:09.286 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-26T17:57:09.287 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-26T17:57:09.288 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-26T17:57:09.289 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-26T17:57:09.290 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 149/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 151/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-26T17:57:09.291 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:11.501 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.502 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.503 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-3267.gbc94a2a9.el9.noarch 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-11.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.504 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-26T17:57:11.505 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.14-1.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-26T17:57:11.506 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-26T17:57:11.507 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-26T17:57:11.508 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-26T17:57:11.509 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-26T17:57:11.510 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-3267.gbc94a2a9.el9.x86_64 2024-04-26T17:57:11.511 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:11.512 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-04-26T17:57:11.951 DEBUG:teuthology.parallel:result is None 2024-04-26T17:57:11.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:57:12.100 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:57:12.126 INFO:teuthology.orchestra.run.smithi012.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:12.127 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:12.127 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:57:12.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:57:12.357 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-26T17:57:12.379 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:12.379 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3267.gbc94a2a9.el9 2024-04-26T17:57:12.379 INFO:teuthology.task.install:The correct ceph version 19.0.0-3267.gbc94a2a9 is installed. 2024-04-26T17:57:12.381 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T17:57:12.381 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:12.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:57:12.413 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:12.413 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T17:57:12.445 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T17:57:12.445 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:12.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:57:12.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:57:12.549 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:12.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T17:57:12.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T17:57:12.637 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T17:57:12.637 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:12.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:57:12.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:57:12.730 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:12.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T17:57:12.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T17:57:12.817 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T17:57:12.818 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:12.818 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:57:12.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:57:12.910 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:12.910 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T17:57:12.934 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T17:57:12.997 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T17:57:13.093 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T17:57:13.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2024-04-26T17:57:13.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-04-26T17:57:13.120 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T17:57:13.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T17:57:13.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T17:57:13.188 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T17:57:13.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T17:57:13.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T17:57:13.269 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-26T17:57:13.269 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-26T17:57:13.269 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-26T17:57:13.270 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:13.270 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T17:57:13.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:13.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:13.452 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:13.452 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-26T17:57:13.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:13.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:13.622 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T17:57:13.622 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T17:57:13.623 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903', 'branch': 'wip-lusov-quiescer-fixes', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}}', 'email': None, 'first_in_suite': False, 'job_id': '7674903', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer-fixes'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer-fixes', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9496, 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer-fixes', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh4gicuwpWNkWrgMw6npH86SLVh3ZLenmbFRF2tO4z9De5eSKtJQhe/3cfs3OkaGPLEk1kqHVzT7LPscCOYfIg=', 'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5AauhDX9kwFG0a316z1l/XqokJARJUaIYbaH1QmJs55p4cEfchci940vvkoN3eZIrmq7rOEdUjSKSIm5XvH0k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-26_17:24:23', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T17:57:13.623 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T17:57:13.626 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T17:57:13.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T17:57:13.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T17:57:13.733 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:13.734 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:57:13.762 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:57:13.762 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2024-04-26T17:57:13.818 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-04-26 17:56:59.865124707 +0000 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-04-26 17:54:34.287905515 +0000 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-04-26 17:54:34.287905515 +0000 2024-04-26T17:57:13.819 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-04-26 17:54:34.287905515 +0000 2024-04-26T17:57:13.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:57:13.883 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-04-26T17:57:13.883 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-04-26T17:57:13.883 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000191391 s, 2.7 MB/s 2024-04-26T17:57:13.884 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:57:13.940 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2024-04-26T17:57:13.996 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-04-26 17:56:59.866124698 +0000 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-04-26 17:54:34.646902126 +0000 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-04-26 17:54:34.646902126 +0000 2024-04-26T17:57:13.997 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-04-26 17:54:34.646902126 +0000 2024-04-26T17:57:13.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:57:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-04-26T17:57:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-04-26T17:57:14.060 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000221848 s, 2.3 MB/s 2024-04-26T17:57:14.061 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:57:14.118 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:14.174 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-04-26 17:56:59.866124698 +0000 2024-04-26T17:57:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-04-26 17:54:35.014898647 +0000 2024-04-26T17:57:14.175 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-04-26 17:54:35.014898647 +0000 2024-04-26T17:57:14.175 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-04-26 17:54:35.014898647 +0000 2024-04-26T17:57:14.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:57:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-04-26T17:57:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-04-26T17:57:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000188769 s, 2.7 MB/s 2024-04-26T17:57:14.238 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:57:14.294 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2024-04-26T17:57:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:57:14.349 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T17:57:14.349 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:14.350 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:14.350 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2024-04-26 17:56:59.866124698 +0000 2024-04-26T17:57:14.350 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-04-26 17:54:35.363895346 +0000 2024-04-26T17:57:14.350 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-04-26 17:54:35.363895346 +0000 2024-04-26T17:57:14.350 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-04-26 17:54:35.363895346 +0000 2024-04-26T17:57:14.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:57:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2024-04-26T17:57:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2024-04-26T17:57:14.414 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000179612 s, 2.9 MB/s 2024-04-26T17:57:14.415 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:57:14.473 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:14.473 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:14.473 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T17:57:14.489 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T17:57:14.490 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-04-26T17:57:14.544 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-26 17:57:03.939370458 +0000 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-26 17:54:44.994718412 +0000 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-26 17:54:44.994718412 +0000 2024-04-26T17:57:14.545 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-26 17:54:44.994718412 +0000 2024-04-26T17:57:14.545 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T17:57:14.606 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-26T17:57:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-26T17:57:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000229633 s, 2.2 MB/s 2024-04-26T17:57:14.608 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T17:57:14.665 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-26 17:57:03.939370458 +0000 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-26 17:54:45.339708844 +0000 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-26 17:54:45.339708844 +0000 2024-04-26T17:57:14.722 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-26 17:54:45.339708844 +0000 2024-04-26T17:57:14.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T17:57:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-26T17:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-26T17:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000197208 s, 2.6 MB/s 2024-04-26T17:57:14.786 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T17:57:14.841 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:14.895 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-26 17:57:03.940370433 +0000 2024-04-26T17:57:14.896 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-26 17:54:45.676699498 +0000 2024-04-26T17:57:14.896 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-26 17:54:45.676699498 +0000 2024-04-26T17:57:14.896 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-26 17:54:45.676699498 +0000 2024-04-26T17:57:14.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T17:57:14.958 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-26T17:57:14.958 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-26T17:57:14.959 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000237574 s, 2.2 MB/s 2024-04-26T17:57:14.960 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T17:57:15.015 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-04-26T17:57:15.070 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-04-26 17:57:03.940370433 +0000 2024-04-26T17:57:15.071 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-04-26 17:54:46.005690373 +0000 2024-04-26T17:57:15.071 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-04-26 17:54:46.005690373 +0000 2024-04-26T17:57:15.071 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-04-26 17:54:46.005690373 +0000 2024-04-26T17:57:15.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T17:57:15.132 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-04-26T17:57:15.132 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-04-26T17:57:15.132 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000185507 s, 2.8 MB/s 2024-04-26T17:57:15.133 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T17:57:15.189 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:15.189 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T17:57:15.189 INFO:tasks.ceph:Generating config... 2024-04-26T17:57:15.190 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-26T17:57:15.190 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-26T17:57:15.191 INFO:tasks.ceph:[client] debug client = 20 2024-04-26T17:57:15.191 INFO:tasks.ceph:[client] debug ms = 1 2024-04-26T17:57:15.191 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-26T17:57:15.191 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-26T17:57:15.191 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-26T17:57:15.191 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-26T17:57:15.192 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-26T17:57:15.193 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-26T17:57:15.193 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T17:57:15.193 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T17:57:15.193 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-26T17:57:15.194 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T17:57:15.195 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T17:57:15.195 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T17:57:15.195 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T17:57:15.195 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-26T17:57:15.195 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T17:57:15.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:15.238 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T17:57:15.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T17:57:15.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:15.390 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.100'), ('mon.c', '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]')] 2024-04-26T17:57:15.390 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-26T17:57:15.391 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:15.391 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T17:57:15.445 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.100 --addv c '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 68faa4ec-4899-41e7-bbbd-182baff15e13 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = quincy 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 68faa4ec-4899-41e7-bbbd-182baff15e13 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2024-04-26T17:57:15.532306+0000 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:created 2024-04-26T17:57:15.532306+0000 2024-04-26T17:57:15.531 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 17 (quincy) 2024-04-26T17:57:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2024-04-26T17:57:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2024-04-26T17:57:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.b 2024-04-26T17:57:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon.c 2024-04-26T17:57:15.532 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T17:57:15.533 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T17:57:15.548 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 68faa4ec-4899-41e7-bbbd-182baff15e13... 2024-04-26T17:57:15.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T17:57:15.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T17:57:15.631 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2024-04-26T17:57:15.632 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T17:57:15.633 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2024-04-26T17:57:15.634 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.635 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 68faa4ec-4899-41e7-bbbd-182baff15e13 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2024-04-26T17:57:15.636 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2024-04-26T17:57:15.637 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug trim objects = true 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2024-04-26T17:57:15.638 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2024-04-26T17:57:15.639 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 20 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 20 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 10 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: mon client directed command retry = 5 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:15.640 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay max = 1 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay type = client mds 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject socket failures = 2500 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: osd blocked scrub grace period = 3600 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: osd max markdown count = 1000 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2024-04-26T17:57:15.642 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2024-04-26T17:57:15.643 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T17:57:15.644 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon down mkfs grace = 300 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2024-04-26T17:57:15.645 INFO:teuthology.orchestra.run.smithi012.stdout: client_shutdown_timeout = 120 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f] 2024-04-26T17:57:15.646 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds balancer = 20 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal fragment size max = 10000 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal merge size = 5 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split bits = 3 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds bal split size = 100 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds oft prefetch dirfrags = True 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds_dir_prefetch = True 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:15.647 INFO:teuthology.orchestra.run.smithi012.stdout: mon client directed command retry = 5 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay max = 1 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject delay type = client mds osd 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject socket failures = 2500 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2024-04-26T17:57:15.648 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2024-04-26T17:57:15.649 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-04-26T17:57:15.650 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-04-26T17:57:15.651 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.12,172.21.15.100,[v2:172.21.15.100:3301,v1:172.21.15.100:6790]" 2024-04-26T17:57:15.652 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 68faa4ec-4899-41e7-bbbd-182baff15e13 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-04-26T17:57:15.653 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-04-26T17:57:15.654 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 20 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 20 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 10 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: mon client directed command retry = 5 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-04-26T17:57:15.655 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay max = 1 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay type = client mds 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject socket failures = 2500 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: osd blocked scrub grace period = 3600 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: osd max markdown count = 1000 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-04-26T17:57:15.656 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-04-26T17:57:15.657 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon down mkfs grace = 300 2024-04-26T17:57:15.658 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: client_shutdown_timeout = 120 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-04-26T17:57:15.659 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal fragment size max = 10000 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal merge size = 5 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split bits = 3 2024-04-26T17:57:15.660 INFO:teuthology.orchestra.run.smithi100.stdout: mds bal split size = 100 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds oft prefetch dirfrags = True 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds_dir_prefetch = True 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mds_sleep_rank_change = 5000000.0 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: mon client directed command retry = 5 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay max = 1 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay probability = 0.005 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject delay type = client mds osd 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: ms inject socket failures = 2500 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-04-26T17:57:15.661 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-04-26T17:57:15.662 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T17:57:15.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T17:57:15.746 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T17:57:15.746 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:15.746 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T17:57:15.762 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:15.762 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T17:57:15.817 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:57:15.817 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:15.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T17:57:15.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:15.890 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:15.890 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:15.946 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:57:15.946 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:15.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T17:57:15.946 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T17:57:15.982 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:15.982 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:16.036 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T17:57:16.036 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T17:57:16.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T17:57:16.086 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T17:57:16.089 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T17:57:16.154 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T17:57:16.155 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T17:57:16.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T17:57:16.206 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T17:57:16.208 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T17:57:16.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T17:57:16.321 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-26T17:57:16.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-26T17:57:16.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T17:57:16.437 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-26T17:57:16.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-26T17:57:16.464 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T17:57:16.512 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-26T17:57:16.514 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-26T17:57:16.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T17:57:16.625 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-26T17:57:16.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-26T17:57:16.650 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T17:57:16.738 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-26T17:57:16.740 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-26T17:57:16.763 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T17:57:16.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:16.804 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T17:57:16.816 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T17:57:16.816 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-26T17:57:16.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:16.880 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:16.880 INFO:tasks.ceph:role: osd.0 2024-04-26T17:57:16.880 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:57:16.881 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T17:57:16.952 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:16.952 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:16.953 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:17.458 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-04-26T17:57:17.460 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-04-26T17:57:17.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:17.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:17.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:17.671 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:17.671 INFO:tasks.ceph:role: osd.1 2024-04-26T17:57:17.672 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:57:17.672 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:17.745 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:18.206 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-04-26T17:57:18.209 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-04-26T17:57:18.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:18.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:18.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:18.398 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:18.398 INFO:tasks.ceph:role: osd.2 2024-04-26T17:57:18.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:57:18.399 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T17:57:18.472 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:18.472 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:18.473 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:18.958 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-04-26T17:57:18.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-04-26T17:57:18.961 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:19.110 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:19.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:19.210 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:19.210 INFO:tasks.ceph:role: osd.3 2024-04-26T17:57:19.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:57:19.210 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:19.284 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:19.801 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2024-04-26T17:57:19.804 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2024-04-26T17:57:19.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:19.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:19.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:20.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.083+0000 7fb629422640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T17:57:20.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.083+0000 7fb629422640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T17:57:20.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.083+0000 7fb629422640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:20.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.083+0000 7fb629422640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:20.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.083+0000 7fb629422640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T17:57:20.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:20.084+0000 7fb629422640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T17:57:22.946 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T17:57:22.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:23.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.067+0000 7f87cd60d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T17:57:23.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.067+0000 7f87cd60d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T17:57:23.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.067+0000 7f87cd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:23.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.067+0000 7f87cd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:23.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.067+0000 7f87cd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T17:57:23.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:23.068+0000 7f87cd60d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T17:57:25.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T17:57:25.942 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:26.034 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.034+0000 7fb9b9188640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T17:57:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.034+0000 7fb9b9188640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T17:57:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.034+0000 7fb9b9188640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.034+0000 7fb9b9188640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.034+0000 7fb9b9188640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T17:57:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:26.035+0000 7fb9b9188640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T17:57:28.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T17:57:28.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.004+0000 7f301620c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-26T17:57:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.004+0000 7f301620c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-26T17:57:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.004+0000 7f301620c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:29.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.004+0000 7f301620c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.004+0000 7f301620c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-26T17:57:29.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:29.005+0000 7f301620c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-26T17:57:31.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-26T17:57:31.896 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:31.925 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:31.925 INFO:tasks.ceph:role: osd.4 2024-04-26T17:57:31.925 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:57:31.925 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:32.000 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:32.508 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-04-26T17:57:32.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-04-26T17:57:32.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:32.652 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:32.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:32.749 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:32.750 INFO:tasks.ceph:role: osd.5 2024-04-26T17:57:32.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:57:32.750 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-26T17:57:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:32.823 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:32.823 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:32.824 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:32.824 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:32.824 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:32.824 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:32.824 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:33.269 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-04-26T17:57:33.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-04-26T17:57:33.272 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:33.357 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:33.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:33.447 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:33.447 INFO:tasks.ceph:role: osd.6 2024-04-26T17:57:33.447 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:57:33.447 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-26T17:57:33.518 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:33.518 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:33.518 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:33.518 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:33.519 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:34.002 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-04-26T17:57:34.003 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-04-26T17:57:34.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:34.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:34.171 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:34.234 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-26T17:57:34.234 INFO:tasks.ceph:role: osd.7 2024-04-26T17:57:34.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T17:57:34.234 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-26T17:57:34.304 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T17:57:34.304 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T17:57:34.304 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T17:57:34.304 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-26T17:57:34.304 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T17:57:34.305 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-04-26T17:57:34.305 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T17:57:34.305 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-26T17:57:34.305 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T17:57:34.305 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T17:57:34.822 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-04-26T17:57:34.824 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-04-26T17:57:34.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:34.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:34.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:35.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.086+0000 7f4c5f014640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-26T17:57:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.086+0000 7f4c5f014640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-26T17:57:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.086+0000 7f4c5f014640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.086+0000 7f4c5f014640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.086+0000 7f4c5f014640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-26T17:57:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:35.087+0000 7f4c5f014640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-26T17:57:37.940 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-26T17:57:37.967 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:38.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-26T17:57:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-26T17:57:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-26T17:57:38.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:38.052+0000 7f0c95012640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-26T17:57:40.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-26T17:57:40.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:41.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.012+0000 7f890a923640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-26T17:57:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.012+0000 7f890a923640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-26T17:57:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.012+0000 7f890a923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.012+0000 7f890a923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.012+0000 7f890a923640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-26T17:57:41.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:41.013+0000 7f890a923640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-26T17:57:43.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:43.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:57:43.860 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-26T17:57:43.885 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.970+0000 7f0c1be0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.971+0000 7f0c1be0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.971+0000 7f0c1be0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.971+0000 7f0c1be0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.971+0000 7f0c1be0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-26T17:57:43.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:43.971+0000 7f0c1be0d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-26T17:57:46.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-26T17:57:46.857 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T17:57:46.858 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:46.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T17:57:46.888 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:46.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T17:57:46.957 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:46.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-26T17:57:47.026 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-26T17:57:47.095 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T17:57:47.163 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T17:57:47.229 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T17:57:47.297 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-26T17:57:47.363 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.363 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T17:57:47.391 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-26T17:57:47.459 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.459 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-26T17:57:47.526 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.526 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-26T17:57:47.591 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-26T17:57:47.655 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-26T17:57:47.719 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-26T17:57:47.783 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:47.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-26T17:57:47.846 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:47.846 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T17:57:47.865 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T17:57:47.865 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T17:57:47.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T17:57:47.929 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-04-26T17:57:47.929 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmqaw6BRAA6s0ERaYgkvAm5XP2x5Ax+Q== 2024-04-26T17:57:47.929 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-04-26T17:57:47.929 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmgEdaDBAAdjsevnTi+9E9NA8dp0VUdg== 2024-04-26T17:57:47.929 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmMpg/ExAAWrNG5nZV3Ot2yP3JJP5YxA== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.e] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmMiUtGhAAS4u0bvWQrm+CQdxcJ+/mwQ== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAA6ytmS00MBRAAl7oZxunVzxjkOc55kxERxg== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAD6ytmWMgTBBAAEzSGoCmvBsXFTa2E/IuYeA== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAG6ytmRlIgAhAAjUbRZgkf3QMjAshud0Nldg== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAJ6ytmpLlYABAAwBStm/0Ndfo7yDbMLqWI1A== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmQscsCRAA7RbZkqw7BaHT1i0XYcH64A== 2024-04-26T17:57:47.930 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmhg+eHhAAjG7CA/LmJbefJeuiCc4Zfw== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmc8FdJRAAErNFL1W1r5l9y4zpkjUeQw== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.f] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itm4w8XLBAAmKi/x8H/70scEoS+cKSHCg== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAP6ytmFc44BRAAIEqZogOQIQzsdZGxDVF4Wg== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAS6ytmrpIoAxAAFdMM57fUBZkeJ+SLFnxzFQ== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAV6ytmXMfOABAAFlHBrcL1tZ3s60Wdsciqvg== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAX6ytmFzXtORAAT7uOyDo72l3Lqml4Xp42MA== 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-04-26T17:57:47.931 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQD86itmPEcDMBAAxDoLK0gwkGU4tMhLTNZuRA== 2024-04-26T17:57:47.932 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2024-04-26T17:57:47.932 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmqaw6BRAA6s0ERaYgkvAm5XP2x5Ax+Q== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmgEdaDBAAdjsevnTi+9E9NA8dp0VUdg== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmMpg/ExAAWrNG5nZV3Ot2yP3JJP5YxA== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.e] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmMiUtGhAAS4u0bvWQrm+CQdxcJ+/mwQ== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAA6ytmS00MBRAAl7oZxunVzxjkOc55kxERxg== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAD6ytmWMgTBBAAEzSGoCmvBsXFTa2E/IuYeA== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAG6ytmRlIgAhAAjUbRZgkf3QMjAshud0Nldg== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAJ6ytmpLlYABAAwBStm/0Ndfo7yDbMLqWI1A== 2024-04-26T17:57:47.933 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmQscsCRAA7RbZkqw7BaHT1i0XYcH64A== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmhg+eHhAAjG7CA/LmJbefJeuiCc4Zfw== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmc8FdJRAAErNFL1W1r5l9y4zpkjUeQw== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.f] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itm4w8XLBAAmKi/x8H/70scEoS+cKSHCg== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAP6ytmFc44BRAAIEqZogOQIQzsdZGxDVF4Wg== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAS6ytmrpIoAxAAFdMM57fUBZkeJ+SLFnxzFQ== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAV6ytmXMfOABAAFlHBrcL1tZ3s60Wdsciqvg== 2024-04-26T17:57:47.934 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2024-04-26T17:57:47.935 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAX6ytmFzXtORAAT7uOyDo72l3Lqml4Xp42MA== 2024-04-26T17:57:47.935 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2024-04-26T17:57:47.935 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD86itmPEcDMBAAxDoLK0gwkGU4tMhLTNZuRA== 2024-04-26T17:57:47.935 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:47.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:48.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.035 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.091 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.251 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.299 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.302 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:48.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T17:57:48.454 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.456 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.564 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T17:57:48.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.618 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.669 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.718 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T17:57:48.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T17:57:48.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T17:57:48.875 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T17:57:48.875 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T17:57:48.899 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:48.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T17:57:49.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T17:57:49.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:49.137 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T17:57:49.160 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T17:57:49.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T17:57:49.317 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T17:57:49.340 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:49.342 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T17:57:49.394 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T17:57:49.394 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T17:57:49.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T17:57:49.398 INFO:tasks.ceph.mon.a:Started 2024-04-26T17:57:49.398 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T17:57:49.398 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T17:57:49.437 INFO:tasks.ceph.mon.b:Started 2024-04-26T17:57:49.437 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T17:57:49.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T17:57:49.439 INFO:tasks.ceph.mon.c:Started 2024-04-26T17:57:49.439 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T17:57:49.441 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T17:57:49.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T17:57:49.443 INFO:tasks.ceph.mgr.y:Started 2024-04-26T17:57:49.443 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T17:57:49.444 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T17:57:49.445 INFO:tasks.ceph.mgr.x:Started 2024-04-26T17:57:49.445 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T17:57:49.446 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.546+0000 7f84c7371640 1 Processor -- start 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.546+0000 7f84c7371640 1 -- start start 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c7371640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 0x7f84c00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c7371640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c01563b0 con 0x7f84c006c4a0 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c7371640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84c015f930 con 0x7f84c006cb20 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c7371640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f84c015c670 con 0x7f84c00caba0 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c510d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 0x7f84c00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c490c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f84c006c4a0 0x7f84c015f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:53144/0 (socket says 172.21.15.12:53144) 2024-04-26T17:57:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c490c640 1 -- 172.21.15.12:0/1794217740 learned_addr learned my addr 172.21.15.12:0/1794217740 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:57:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c510d640 1 -- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 msgr2=0x7f84c00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-26T17:57:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c510d640 1 -- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 msgr2=0x7f84c00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T17:57:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c510d640 1 --2- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 0x7f84c00caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:57:49.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.547+0000 7f84c510d640 1 --2- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 0x7f84c00caf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.701+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044812599 0 0) 0x7f84c01563b0 con 0x7f84c006c4a0 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.701+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84ac003520 con 0x7f84c006c4a0 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412572461 0 0) 0x7f84c015f930 con 0x7f84c006cb20 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84c01563b0 con 0x7f84c006cb20 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22986497 0 0) 0x7f84c01563b0 con 0x7f84c006cb20 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 msgr2=0x7f84c00caf80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T17:57:49.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 --2- 172.21.15.12:0/1794217740 >> v2:172.21.15.12:3300/0 conn(0x7f84c00caba0 0x7f84c00caf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 >> v1:172.21.15.12:6789/0 conn(0x7f84c006c4a0 legacy=0x7f84c015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c00b0f60 con 0x7f84c006cb20 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f84b80019f0 con 0x7f84c006cb20 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 >> v1:172.21.15.100:6789/0 conn(0x7f84c006cb20 legacy=0x7f84c01665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac003b90 0x7f84ac003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ac004800 0x7f84ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 0x7f84ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84c015c670 con 0x7f84ac004800 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac00c090 con 0x7f84ac005210 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac00c290 con 0x7f84ac003b90 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84c510d640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac003b90 0x7f84ac003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84c590e640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 0x7f84ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.702+0000 7f84c490c640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ac004800 0x7f84ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c590e640 1 -- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac003b90 msgr2=0x7f84ac003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c590e640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac003b90 0x7f84ac003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c590e640 1 -- 172.21.15.12:0/1794217740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ac004800 msgr2=0x7f84ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c590e640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ac004800 0x7f84ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c590e640 1 -- 172.21.15.12:0/1794217740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c01563b0 con 0x7f84ac005210 2024-04-26T17:57:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c490c640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84ac004800 0x7f84ac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.703+0000 7f84c510d640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac003b90 0x7f84ac003f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.704+0000 7f84c590e640 1 -- 172.21.15.12:0/1794217740 reap_dead start 2024-04-26T17:57:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.704+0000 7f84c590e640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 0x7f84ac00b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c4c0 tx=0x7f84ac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434026c5c463912b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.704+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b8034020 con 0x7f84ac005210 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.704+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b8030690 con 0x7f84ac005210 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.704+0000 7f84b7fff640 1 -- 172.21.15.12:0/1794217740 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b000b5e0 con 0x7f84ac005210 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 -- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 msgr2=0x7f84ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 0x7f84ac00b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c4c0 tx=0x7f84ac005830 comp rx=0 tx=0).stop 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 -- 172.21.15.12:0/1794217740 shutdown_connections 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 --2- 172.21.15.12:0/1794217740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84ac005210 0x7f84ac00b9c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 -- 172.21.15.12:0/1794217740 >> 172.21.15.12:0/1794217740 conn(0x7f84c0070a50 msgr2=0x7f84c0070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 -- 172.21.15.12:0/1794217740 shutdown_connections 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.705+0000 7f84c7371640 1 -- 172.21.15.12:0/1794217740 wait complete. 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.706+0000 7f84c7371640 1 Processor -- start 2024-04-26T17:57:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.706+0000 7f84c7371640 1 -- start start 2024-04-26T17:57:49.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84c01f51d0 0x7f84c00c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:49.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f84c015c020 con 0x7f84c00c39a0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f84c015bd40 con 0x7f84c01f51d0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c7371640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f84c015c300 con 0x7f84ac005210 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c490c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c510d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c510d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:40632/0 (socket says 172.21.15.12:40632) 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c490c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43278/0 (socket says 172.21.15.12:43278) 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c490c640 1 -- 172.21.15.12:0/4170992734 learned_addr learned my addr 172.21.15.12:0/4170992734 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.707+0000 7f84c590e640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84c01f51d0 0x7f84c00c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 -- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 msgr2=0x7f84c01f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 -- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84c01f51d0 msgr2=0x7f84c00c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84c01f51d0 0x7f84c00c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 -- 172.21.15.12:0/4170992734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c01f59f0 con 0x7f84c00c39a0 2024-04-26T17:57:49.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c510d640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c490c640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007340 tx=0x7f84bc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc001d10 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc018070 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00fbc0 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.708+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c01f5cb0 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.709+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c01f1fb0 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.709+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f84bc01d460 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.709+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f84bc0136b0 con 0x7f84c00c39a0 2024-04-26T17:57:49.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.710+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c0076d20 con 0x7f84c00c39a0 2024-04-26T17:57:49.712 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.712+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f84bc00fd60 con 0x7f84c00c39a0 2024-04-26T17:57:49.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.779+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f84c00b3810 con 0x7f84c00c39a0 2024-04-26T17:57:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.781+0000 7f84b5ffb640 1 -- 172.21.15.12:0/4170992734 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f84bc01d930 con 0x7f84c00c39a0 2024-04-26T17:57:49.781 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 msgr2=0x7f84c015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f84bc007340 tx=0x7f84bc007800 comp rx=0 tx=0).stop 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 shutdown_connections 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84c01f51d0 0x7f84c00c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84c00c39a0 0x7f84c015d910 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 --2- 172.21.15.12:0/4170992734 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f84ac005210 0x7f84c01f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:49.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 >> 172.21.15.12:0/4170992734 conn(0x7f84c0070a50 msgr2=0x7f84c01527e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:49.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 shutdown_connections 2024-04-26T17:57:49.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:49.782+0000 7f84c7371640 1 -- 172.21.15.12:0/4170992734 wait complete. 2024-04-26T17:57:49.793 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T17:57:49.793 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T17:57:49.793 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:49.794 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T17:57:49.814 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:49.814+0000 7f333c412040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:57:49.818 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:49.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T17:57:49.822 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:49.822+0000 7ff53c8a1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T17:57:49.846 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:49.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T17:57:49.910 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:57:49.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-26T17:57:49.964 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:49.964+0000 7f333c412040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:49.975 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:49.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-26T17:57:49.984 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:49.984+0000 7ff53c8a1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:49.999 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:49.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-26T17:57:50.020 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:50.020+0000 7f333c412040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:57:50.040 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:50.040+0000 7ff53c8a1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T17:57:50.043 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:50.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-26T17:57:50.107 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-04-26T17:57:50.107 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-26T17:57:50.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 1adbc690-5e83-47f4-ab1e-685843b3a483 0 2024-04-26T17:57:50.266 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:50.266+0000 7f333c412040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:57:50.301 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:50.301+0000 7ff53c8a1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T17:57:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.307+0000 7f37e435f640 1 Processor -- start 2024-04-26T17:57:50.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.307+0000 7f37e435f640 1 -- start start 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37dc06d0b0 0x7f37dc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37dc072f40 0x7f37dc06c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0c8c90 con 0x7f37dc072f40 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f37dc0c8f30 con 0x7f37dc06d0b0 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e435f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0c9210 con 0x7f37dc153e40 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e20fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e18fa640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37dc06d0b0 0x7f37dc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e20fb640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34430/0 (socket says 172.21.15.100:34430) 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.308+0000 7f37e20fb640 1 -- 172.21.15.100:0/3379407716 learned_addr learned my addr 172.21.15.100:0/3379407716 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e28fc640 1 --2- 172.21.15.100:0/3379407716 >> v2:172.21.15.12:3300/0 conn(0x7f37dc072f40 0x7f37dc06c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 -- 172.21.15.100:0/3379407716 >> v2:172.21.15.100:3300/0 conn(0x7f37dc06d0b0 msgr2=0x7f37dc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:50.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 --2- 172.21.15.100:0/3379407716 >> v2:172.21.15.100:3300/0 conn(0x7f37dc06d0b0 0x7f37dc159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 -- 172.21.15.100:0/3379407716 >> v2:172.21.15.12:3300/0 conn(0x7f37dc072f40 msgr2=0x7f37dc06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 --2- 172.21.15.100:0/3379407716 >> v2:172.21.15.12:3300/0 conn(0x7f37dc072f40 0x7f37dc06c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 -- 172.21.15.100:0/3379407716 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0c94f0 con 0x7f37dc153e40 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.309+0000 7f37e20fb640 1 --2- 172.21.15.100:0/3379407716 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37dc069100 tx=0x7f37d802a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f3548f9c9ea7ce server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e10f9640 1 -- 172.21.15.100:0/3379407716 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8037070 con 0x7f37dc153e40 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e10f9640 1 -- 172.21.15.100:0/3379407716 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d8032440 con 0x7f37dc153e40 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e10f9640 1 -- 172.21.15.100:0/3379407716 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8032810 con 0x7f37dc153e40 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 -- 172.21.15.100:0/3379407716 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 msgr2=0x7f37dc15dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 --2- 172.21.15.100:0/3379407716 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f37dc069100 tx=0x7f37d802a1e0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 -- 172.21.15.100:0/3379407716 shutdown_connections 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 --2- 172.21.15.100:0/3379407716 >> v2:172.21.15.12:3300/0 conn(0x7f37dc072f40 0x7f37dc06c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 --2- 172.21.15.100:0/3379407716 >> v2:172.21.15.100:3300/0 conn(0x7f37dc06d0b0 0x7f37dc159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 --2- 172.21.15.100:0/3379407716 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc15dc40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 -- 172.21.15.100:0/3379407716 >> 172.21.15.100:0/3379407716 conn(0x7f37dc070a50 msgr2=0x7f37dc070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 -- 172.21.15.100:0/3379407716 shutdown_connections 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.310+0000 7f37e435f640 1 -- 172.21.15.100:0/3379407716 wait complete. 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.311+0000 7f37e435f640 1 Processor -- start 2024-04-26T17:57:50.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.311+0000 7f37e435f640 1 -- start start 2024-04-26T17:57:50.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37dc06d0b0 0x7f37dc148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc15d720 con 0x7f37dc06d0b0 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc15d440 con 0x7f37dc072f40 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e435f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0b3b50 con 0x7f37dc153e40 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e28fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38980/0 (socket says 172.21.15.100:38980) 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 -- 172.21.15.100:0/4190127104 learned_addr learned my addr 172.21.15.100:0/4190127104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e28fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34434/0 (socket says 172.21.15.100:34434) 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e20fb640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37dc06d0b0 0x7f37dc148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 -- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 msgr2=0x7f37dc14f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc14f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 -- 172.21.15.100:0/4190127104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37dc06d0b0 msgr2=0x7f37dc148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.312+0000 7f37e18fa640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37dc06d0b0 0x7f37dc148b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37e18fa640 1 -- 172.21.15.100:0/4190127104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc1486b0 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37e18fa640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e870 tx=0x7f37cc00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc017070 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc00c8c0 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00cc90 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc0c8520 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc14de60 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f37cc01a070 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.313+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f37cc013470 con 0x7f37dc072f40 2024-04-26T17:57:50.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.314+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc076d20 con 0x7f37dc072f40 2024-04-26T17:57:50.317 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:50.315+0000 7f333c412040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:57:50.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.316+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f37cc00ce30 con 0x7f37dc072f40 2024-04-26T17:57:50.350 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:50.349+0000 7ff53c8a1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T17:57:50.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.388+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1adbc690-5e83-47f4-ab1e-685843b3a483", "id": 0} v 0) -- 0x7f37dc0b0ca0 con 0x7f37dc072f40 2024-04-26T17:57:50.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.391+0000 7f37d2ffd640 1 -- 172.21.15.100:0/4190127104 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1adbc690-5e83-47f4-ab1e-685843b3a483", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f37cc005990 con 0x7f37dc072f40 2024-04-26T17:57:50.391 INFO:teuthology.orchestra.run.smithi100.stdout:0 2024-04-26T17:57:50.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 msgr2=0x7f37dc14ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e870 tx=0x7f37cc00ed30 comp rx=0 tx=0).stop 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 shutdown_connections 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37dc153e40 0x7f37dc14f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37dc072f40 0x7f37dc14ec20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 --2- 172.21.15.100:0/4190127104 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37dc06d0b0 0x7f37dc148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 >> 172.21.15.100:0/4190127104 conn(0x7f37dc070a50 msgr2=0x7f37dc0b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 shutdown_connections 2024-04-26T17:57:50.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.392+0000 7f37e435f640 1 -- 172.21.15.100:0/4190127104 wait complete. 2024-04-26T17:57:50.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new e554ee8b-7026-48fb-b482-9df9f0f8f377 1 2024-04-26T17:57:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.500+0000 7fb14e5f7640 1 Processor -- start 2024-04-26T17:57:50.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.500+0000 7fb14e5f7640 1 -- start start 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14e5f7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 0x7fb148071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14e5f7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1480ca490 con 0x7fb1480c6210 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14e5f7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1480cb8e0 con 0x7fb148071ad0 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14e5f7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480cbfa0 con 0x7fb1480cafd0 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb147fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb148071ad0 0x7fb1480c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52116/0 (socket says 172.21.15.100:52116) 2024-04-26T17:57:50.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb147fff640 1 -- 172.21.15.100:0/1015215557 learned_addr learned my addr 172.21.15.100:0/1015215557 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14cb94640 1 --2- 172.21.15.100:0/1015215557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 0x7fb148071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751610590 0 0) 0x7fb1480cb8e0 con 0x7fb148071ad0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb130003520 con 0x7fb148071ad0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172466806 0 0) 0x7fb1480ca490 con 0x7fb1480c6210 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14cb94640 1 -- 172.21.15.100:0/1015215557 >> v1:172.21.15.100:6789/0 conn(0x7fb148071ad0 legacy=0x7fb1480c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14cb94640 1 -- 172.21.15.100:0/1015215557 >> v1:172.21.15.12:6789/0 conn(0x7fb1480c6210 legacy=0x7fb1480ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.501+0000 7fb14cb94640 1 -- 172.21.15.100:0/1015215557 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480cbba0 con 0x7fb1480cafd0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.502+0000 7fb14cb94640 1 --2- 172.21.15.100:0/1015215557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 0x7fb148071eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb140009dc0 tx=0x7fb14002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6978525d0eef1a50 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.502+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140007740 con 0x7fb1480cafd0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.502+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1400078e0 con 0x7fb1480cafd0 2024-04-26T17:57:50.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.502+0000 7fb146ffd640 1 -- 172.21.15.100:0/1015215557 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb140007cb0 con 0x7fb1480cafd0 2024-04-26T17:57:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 -- 172.21.15.100:0/1015215557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 msgr2=0x7fb148071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/1015215557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 0x7fb148071eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb140009dc0 tx=0x7fb14002a6d0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 -- 172.21.15.100:0/1015215557 shutdown_connections 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/1015215557 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480cafd0 0x7fb148071eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 -- 172.21.15.100:0/1015215557 >> 172.21.15.100:0/1015215557 conn(0x7fb1480746d0 msgr2=0x7fb148076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 -- 172.21.15.100:0/1015215557 shutdown_connections 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.503+0000 7fb14e5f7640 1 -- 172.21.15.100:0/1015215557 wait complete. 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.504+0000 7fb14e5f7640 1 Processor -- start 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.504+0000 7fb14e5f7640 1 -- start start 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 0x7fb1481484e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1480cafd0 0x7fb148147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480cc7b0 con 0x7fb1480cafd0 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480cc4d0 con 0x7fb148071ad0 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14e5f7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480cb5a0 con 0x7fb1480c6210 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb147fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 0x7fb1481484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb147fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38984/0 (socket says 172.21.15.100:38984) 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb147fff640 1 -- 172.21.15.100:0/2623206970 learned_addr learned my addr 172.21.15.100:0/2623206970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb14cb94640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1480cafd0 0x7fb148147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 -- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 msgr2=0x7fb148141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 -- 172.21.15.100:0/2623206970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1480cafd0 msgr2=0x7fb148147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1480cafd0 0x7fb148147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 -- 172.21.15.100:0/2623206970 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480cd6d0 con 0x7fb1480c6210 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb147fff640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:50.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.505+0000 7fb1477fe640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 0x7fb1481484e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c450 tx=0x7fb13800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb138017070 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1380035f0 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb148149af0 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1380039e0 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1480ce6d0 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb13801a070 con 0x7fb1480c6210 2024-04-26T17:57:50.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.506+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb1380127b0 con 0x7fb1480c6210 2024-04-26T17:57:50.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.507+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb148069ae0 con 0x7fb1480c6210 2024-04-26T17:57:50.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.509+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb138021070 con 0x7fb1480c6210 2024-04-26T17:57:50.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.581+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e554ee8b-7026-48fb-b482-9df9f0f8f377", "id": 1} v 0) -- 0x7fb148076d20 con 0x7fb1480c6210 2024-04-26T17:57:50.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb144ff9640 1 -- 172.21.15.100:0/2623206970 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e554ee8b-7026-48fb-b482-9df9f0f8f377", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb148149af0 con 0x7fb1480c6210 2024-04-26T17:57:50.584 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 msgr2=0x7fb1481484e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 0x7fb1481484e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb13800c450 tx=0x7fb13800c910 comp rx=0 tx=0).stop 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 shutdown_connections 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1480cafd0 0x7fb148147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1480c6210 0x7fb1481484e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 --2- 172.21.15.100:0/2623206970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb148071ad0 0x7fb148141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.585+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 >> 172.21.15.100:0/2623206970 conn(0x7fb1480746d0 msgr2=0x7fb148153cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.586+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 shutdown_connections 2024-04-26T17:57:50.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.586+0000 7fb14e5f7640 1 -- 172.21.15.100:0/2623206970 wait complete. 2024-04-26T17:57:50.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac 2 2024-04-26T17:57:50.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.693+0000 7fdd788bd640 1 Processor -- start 2024-04-26T17:57:50.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.693+0000 7fdd788bd640 1 -- start start 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd74071ad0 0x7fdd74071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 0x7fdd740cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdd740cbfa0 con 0x7fdd74071ad0 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdd740cb280 con 0x7fdd740ca8c0 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd788bd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdd740cb8e0 con 0x7fdd740c6210 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd72d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 0x7fdd740cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd72d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 0x7fdd740cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38998/0 (socket says 172.21.15.100:38998) 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34464/0 (socket says 172.21.15.100:34464) 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd72d9d640 1 -- 172.21.15.100:0/3576113996 learned_addr learned my addr 172.21.15.100:0/3576113996 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.694+0000 7fdd7259c640 1 --2- 172.21.15.100:0/3576113996 >> v2:172.21.15.12:3300/0 conn(0x7fdd74071ad0 0x7fdd74071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 -- 172.21.15.100:0/3576113996 >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 msgr2=0x7fdd740cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 --2- 172.21.15.100:0/3576113996 >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 0x7fdd740cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 -- 172.21.15.100:0/3576113996 >> v2:172.21.15.12:3300/0 conn(0x7fdd74071ad0 msgr2=0x7fdd74071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 --2- 172.21.15.100:0/3576113996 >> v2:172.21.15.12:3300/0 conn(0x7fdd74071ad0 0x7fdd74071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 -- 172.21.15.100:0/3576113996 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd740cbba0 con 0x7fdd740c6210 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd6bfff640 1 --2- 172.21.15.100:0/3576113996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd740702d0 tx=0x7fdd5c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff8203136351271 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd71d9b640 1 -- 172.21.15.100:0/3576113996 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c037070 con 0x7fdd740c6210 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd71d9b640 1 -- 172.21.15.100:0/3576113996 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c032440 con 0x7fdd740c6210 2024-04-26T17:57:50.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.695+0000 7fdd71d9b640 1 -- 172.21.15.100:0/3576113996 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c02ae60 con 0x7fdd740c6210 2024-04-26T17:57:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 -- 172.21.15.100:0/3576113996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 msgr2=0x7fdd740c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3576113996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdd740702d0 tx=0x7fdd5c02a110 comp rx=0 tx=0).stop 2024-04-26T17:57:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 -- 172.21.15.100:0/3576113996 shutdown_connections 2024-04-26T17:57:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3576113996 >> v2:172.21.15.100:3300/0 conn(0x7fdd740ca8c0 0x7fdd740cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3576113996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740c6210 0x7fdd740c9d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3576113996 >> v2:172.21.15.12:3300/0 conn(0x7fdd74071ad0 0x7fdd74071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 -- 172.21.15.100:0/3576113996 >> 172.21.15.100:0/3576113996 conn(0x7fdd740746d0 msgr2=0x7fdd74076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 -- 172.21.15.100:0/3576113996 shutdown_connections 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.696+0000 7fdd788bd640 1 -- 172.21.15.100:0/3576113996 wait complete. 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.697+0000 7fdd788bd640 1 Processor -- start 2024-04-26T17:57:50.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.697+0000 7fdd788bd640 1 -- start start 2024-04-26T17:57:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd74071ad0 0x7fdd74153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 0x7fdd741f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740cc7b0 con 0x7fdd74071ad0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdd740cc4d0 con 0x7fdd740c6210 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd788bd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdd740cb5a0 con 0x7fdd740ca8c0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd6bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39006/0 (socket says 172.21.15.100:39006) 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 0x7fdd741f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd6bfff640 1 -- 172.21.15.100:0/3479172267 learned_addr learned my addr 172.21.15.100:0/3479172267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd7259c640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd74071ad0 0x7fdd74153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 -- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 msgr2=0x7fdd7414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 -- 172.21.15.100:0/3479172267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd74071ad0 msgr2=0x7fdd74153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd74071ad0 0x7fdd74153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.698+0000 7fdd72d9d640 1 -- 172.21.15.100:0/3479172267 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd740cea60 con 0x7fdd740ca8c0 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6bfff640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:50.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd72d9d640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 0x7fdd741f2830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00ebd0 tx=0x7fdd6c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c00cb20 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd6c00ccc0 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd6c003bb0 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd740ced20 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd740cf2e0 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdd6c005d10 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.699+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fdd6c014860 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.700+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd74069ae0 con 0x7fdd740ca8c0 2024-04-26T17:57:50.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.702+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdd6c022020 con 0x7fdd740ca8c0 2024-04-26T17:57:50.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.775+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac", "id": 2} v 0) -- 0x7fdd74076d20 con 0x7fdd740ca8c0 2024-04-26T17:57:50.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd6affd640 1 -- 172.21.15.100:0/3479172267 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fdd6c010040 con 0x7fdd740ca8c0 2024-04-26T17:57:50.780 INFO:teuthology.orchestra.run.smithi100.stdout:2 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 msgr2=0x7fdd741f2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 0x7fdd741f2830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c00ebd0 tx=0x7fdd6c00c490 comp rx=0 tx=0).stop 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 shutdown_connections 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdd740ca8c0 0x7fdd741f2830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd740c6210 0x7fdd7414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 --2- 172.21.15.100:0/3479172267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd74071ad0 0x7fdd74153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.781+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 >> 172.21.15.100:0/3479172267 conn(0x7fdd740746d0 msgr2=0x7fdd74154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.782+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 shutdown_connections 2024-04-26T17:57:50.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.782+0000 7fdd788bd640 1 -- 172.21.15.100:0/3479172267 wait complete. 2024-04-26T17:57:50.791 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0 3 2024-04-26T17:57:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.898+0000 7f3a3cdc6640 1 Processor -- start 2024-04-26T17:57:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.898+0000 7f3a3cdc6640 1 -- start start 2024-04-26T17:57:50.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3cdc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 0x7f3a380c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3cdc6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3cdc6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3815cbd0 con 0x7f3a3815fb20 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3cdc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3815f690 con 0x7f3a38155fd0 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3cdc6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3a381563b0 con 0x7f3a380cb5d0 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34484/0 (socket says 172.21.15.100:34484) 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a2ffff640 1 -- 172.21.15.100:0/4209329875 learned_addr learned my addr 172.21.15.100:0/4209329875 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.899+0000 7f3a3659c640 1 --2- 172.21.15.100:0/4209329875 >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 0x7f3a380c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a2ffff640 1 -- 172.21.15.100:0/4209329875 >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 msgr2=0x7f3a380c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a2ffff640 1 --2- 172.21.15.100:0/4209329875 >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 0x7f3a380c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a2ffff640 1 -- 172.21.15.100:0/4209329875 >> v1:172.21.15.12:6789/0 conn(0x7f3a3815fb20 legacy=0x7f3a380ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a2ffff640 1 -- 172.21.15.100:0/4209329875 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3815c330 con 0x7f3a380cb5d0 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a3659c640 1 --2- 172.21.15.100:0/4209329875 >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 0x7f3a380c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a2ffff640 1 --2- 172.21.15.100:0/4209329875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009850 tx=0x7f3a2002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c64a56975e8a33 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a35d9b640 1 -- 172.21.15.100:0/4209329875 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20004030 con 0x7f3a380cb5d0 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a35d9b640 1 -- 172.21.15.100:0/4209329875 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a200041d0 con 0x7f3a380cb5d0 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.900+0000 7f3a35d9b640 1 -- 172.21.15.100:0/4209329875 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a20003610 con 0x7f3a380cb5d0 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/4209329875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 msgr2=0x7f3a3815bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/4209329875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a20009850 tx=0x7f3a2002a230 comp rx=0 tx=0).stop 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/4209329875 shutdown_connections 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/4209329875 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a380cb5d0 0x7f3a3815bc80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/4209329875 >> v2:172.21.15.12:3300/0 conn(0x7f3a38155fd0 0x7f3a380c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/4209329875 >> 172.21.15.100:0/4209329875 conn(0x7f3a3806c310 msgr2=0x7f3a3806c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:50.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/4209329875 shutdown_connections 2024-04-26T17:57:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.901+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/4209329875 wait complete. 2024-04-26T17:57:50.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.902+0000 7f3a3cdc6640 1 Processor -- start 2024-04-26T17:57:50.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.902+0000 7f3a3cdc6640 1 -- start start 2024-04-26T17:57:50.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 0x7f3a381e6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3815f320 con 0x7f3a380cb5d0 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3815c8f0 con 0x7f3a3815fb20 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3cdc6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3a380cc3f0 con 0x7f3a38155fd0 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34498/0 (socket says 172.21.15.100:34498) 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a2ffff640 1 -- 172.21.15.100:0/281086139 learned_addr learned my addr 172.21.15.100:0/281086139 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39022/0 (socket says 172.21.15.100:39022) 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a3659c640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 0x7f3a381e6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:50.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 -- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 msgr2=0x7f3a380c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 -- 172.21.15.100:0/281086139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 msgr2=0x7f3a381e6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.903+0000 7f3a36d9d640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 0x7f3a381e6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a36d9d640 1 -- 172.21.15.100:0/281086139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a380c7650 con 0x7f3a3815fb20 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2ffff640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a3659c640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 0x7f3a381e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a36d9d640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c700 tx=0x7f3a3000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30003b70 con 0x7f3a3815fb20 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a30003d10 con 0x7f3a3815fb20 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a380c7bb0 con 0x7f3a3815fb20 2024-04-26T17:57:50.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30005310 con 0x7f3a3815fb20 2024-04-26T17:57:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a381f2ea0 con 0x7f3a3815fb20 2024-04-26T17:57:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a300054b0 con 0x7f3a3815fb20 2024-04-26T17:57:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.904+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f3a300128b0 con 0x7f3a3815fb20 2024-04-26T17:57:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.905+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a38069ae0 con 0x7f3a3815fb20 2024-04-26T17:57:50.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.907+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3a380c7650 con 0x7f3a3815fb20 2024-04-26T17:57:50.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.993+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0", "id": 3} v 0) -- 0x7f3a38076d20 con 0x7f3a3815fb20 2024-04-26T17:57:50.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.998+0000 7f3a2effd640 1 -- 172.21.15.100:0/281086139 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f3a30012b90 con 0x7f3a3815fb20 2024-04-26T17:57:50.998 INFO:teuthology.orchestra.run.smithi100.stdout:3 2024-04-26T17:57:50.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 msgr2=0x7f3a381f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:50.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c700 tx=0x7f3a3000cbc0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 shutdown_connections 2024-04-26T17:57:50.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a3815fb20 0x7f3a381f3c60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:50.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3a38155fd0 0x7f3a380c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 --2- 172.21.15.100:0/281086139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3a380cb5d0 0x7f3a381e6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 >> 172.21.15.100:0/281086139 conn(0x7f3a3806c310 msgr2=0x7f3a3814f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 shutdown_connections 2024-04-26T17:57:51.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:50.999+0000 7f3a3cdc6640 1 -- 172.21.15.100:0/281086139 wait complete. 2024-04-26T17:57:51.009 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 49037eb9-6acc-47aa-aa02-f6f234754e9f 4 2024-04-26T17:57:51.070 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.070+0000 7f333c412040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:57:51.086 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.086+0000 7ff53c8a1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T17:57:51.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.106+0000 7f3eddecf640 1 Processor -- start 2024-04-26T17:57:51.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 -- start start 2024-04-26T17:57:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3ed80caba0 0x7f3ed80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ed806cb20 0x7f3ed81665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ed81563b0 con 0x7f3ed806c4a0 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed815c670 con 0x7f3ed80caba0 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3eddecf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3ed815f930 con 0x7f3ed806cb20 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3ed7fff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3ed806cb20 0x7f3ed81665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3ed6ffd640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3ed806c4a0 0x7f3ed815f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52128/0 (socket says 172.21.15.100:52128) 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.107+0000 7f3ed6ffd640 1 -- 172.21.15.100:0/410149094 learned_addr learned my addr 172.21.15.100:0/410149094 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed77fe640 1 --2- 172.21.15.100:0/410149094 >> v2:172.21.15.12:3300/0 conn(0x7f3ed80caba0 0x7f3ed80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed7fff640 1 -- 172.21.15.100:0/410149094 >> v2:172.21.15.12:3300/0 conn(0x7f3ed80caba0 msgr2=0x7f3ed80caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed7fff640 1 --2- 172.21.15.100:0/410149094 >> v2:172.21.15.12:3300/0 conn(0x7f3ed80caba0 0x7f3ed80caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed7fff640 1 -- 172.21.15.100:0/410149094 >> v1:172.21.15.100:6789/0 conn(0x7f3ed806c4a0 legacy=0x7f3ed815f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed7fff640 1 -- 172.21.15.100:0/410149094 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80b0f60 con 0x7f3ed806cb20 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed67fc640 1 -- 172.21.15.100:0/410149094 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903142868 0 0) 0x7f3ed81563b0 con 0x7f3ed806c4a0 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.108+0000 7f3ed7fff640 1 --2- 172.21.15.100:0/410149094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed81665b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80cbfc0 tx=0x7f3ed002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=621bfc5b2e3b302f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3ed67fc640 1 -- 172.21.15.100:0/410149094 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0007740 con 0x7f3ed806cb20 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3ed67fc640 1 -- 172.21.15.100:0/410149094 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ed00078e0 con 0x7f3ed806cb20 2024-04-26T17:57:51.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3ed67fc640 1 -- 172.21.15.100:0/410149094 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0007cb0 con 0x7f3ed806cb20 2024-04-26T17:57:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 -- 172.21.15.100:0/410149094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 msgr2=0x7f3ed81665b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 --2- 172.21.15.100:0/410149094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed81665b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80cbfc0 tx=0x7f3ed002a710 comp rx=0 tx=0).stop 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 -- 172.21.15.100:0/410149094 shutdown_connections 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 --2- 172.21.15.100:0/410149094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed81665b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 --2- 172.21.15.100:0/410149094 >> v2:172.21.15.12:3300/0 conn(0x7f3ed80caba0 0x7f3ed80caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 -- 172.21.15.100:0/410149094 >> 172.21.15.100:0/410149094 conn(0x7f3ed8070a50 msgr2=0x7f3ed8070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 -- 172.21.15.100:0/410149094 shutdown_connections 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.109+0000 7f3eddecf640 1 -- 172.21.15.100:0/410149094 wait complete. 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.111+0000 7f3eddecf640 1 Processor -- start 2024-04-26T17:57:51.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.111+0000 7f3eddecf640 1 -- start start 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed80caba0 0x7f3ed8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed815c020 con 0x7f3ed80caba0 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3ed815bd40 con 0x7f3ed806cb20 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.112+0000 7f3eddecf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3ed815c300 con 0x7f3ed806c4a0 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed77fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed77fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34502/0 (socket says 172.21.15.100:34502) 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed77fe640 1 -- 172.21.15.100:0/3835919132 learned_addr learned my addr 172.21.15.100:0/3835919132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed7fff640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed80caba0 0x7f3ed8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 -- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 msgr2=0x7f3ed80b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 -- 172.21.15.100:0/3835919132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed80caba0 msgr2=0x7f3ed8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed80caba0 0x7f3ed8154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 -- 172.21.15.100:0/3835919132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ed80b30d0 con 0x7f3ed806cb20 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed77fe640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ed6ffd640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed8154950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c450 tx=0x7f3ecc00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc018070 con 0x7f3ed806cb20 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ecc0074e0 con 0x7f3ed806cb20 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ed81f21c0 con 0x7f3ed806cb20 2024-04-26T17:57:51.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc004a20 con 0x7f3ed806cb20 2024-04-26T17:57:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ed81f2780 con 0x7f3ed806cb20 2024-04-26T17:57:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ecc01b070 con 0x7f3ed806cb20 2024-04-26T17:57:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.113+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3ecc012910 con 0x7f3ed806cb20 2024-04-26T17:57:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.114+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ed8076d20 con 0x7f3ed806cb20 2024-04-26T17:57:51.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.116+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3ecc012bb0 con 0x7f3ed806cb20 2024-04-26T17:57:51.163 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.163+0000 7f333c412040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:51.178 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.179+0000 7ff53c8a1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:51.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.189+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49037eb9-6acc-47aa-aa02-f6f234754e9f", "id": 4} v 0) -- 0x7f3ed8155b60 con 0x7f3ed806cb20 2024-04-26T17:57:51.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.194+0000 7f3ebffff640 1 -- 172.21.15.100:0/3835919132 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49037eb9-6acc-47aa-aa02-f6f234754e9f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3ecc004bc0 con 0x7f3ed806cb20 2024-04-26T17:57:51.194 INFO:teuthology.orchestra.run.smithi100.stdout:4 2024-04-26T17:57:51.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 msgr2=0x7f3ed8154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed8154950 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c450 tx=0x7f3ecc00c910 comp rx=0 tx=0).stop 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 shutdown_connections 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ed80caba0 0x7f3ed8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ed806cb20 0x7f3ed8154950 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 --2- 172.21.15.100:0/3835919132 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3ed806c4a0 0x7f3ed80b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 >> 172.21.15.100:0/3835919132 conn(0x7f3ed8070a50 msgr2=0x7f3ed8153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 shutdown_connections 2024-04-26T17:57:51.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.195+0000 7f3eddecf640 1 -- 172.21.15.100:0/3835919132 wait complete. 2024-04-26T17:57:51.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 0de27771-aa00-462a-b1db-c1fe635d3d2a 5 2024-04-26T17:57:51.208 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.209+0000 7f333c412040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:57:51.224 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.224+0000 7ff53c8a1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T17:57:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 Processor -- start 2024-04-26T17:57:51.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 -- start start 2024-04-26T17:57:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc92c0c9be0 0x7fc92c0c4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc92c0cf0f0 0x7fc92c0cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c15c670 con 0x7fc92c0c9be0 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c156250 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.303+0000 7fc9312a0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c15bac0 con 0x7fc92c155e70 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc92c0cf0f0 0x7fc92c0cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92affd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92affd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34506/0 (socket says 172.21.15.100:34506) 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc92c0cf0f0 0x7fc92c0cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39060/0 (socket says 172.21.15.100:39060) 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92affd640 1 -- 172.21.15.100:0/3648572389 learned_addr learned my addr 172.21.15.100:0/3648572389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92a7fc640 1 --2- 172.21.15.100:0/3648572389 >> v2:172.21.15.12:3300/0 conn(0x7fc92c0c9be0 0x7fc92c0c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 -- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 msgr2=0x7fc92c0c4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 -- 172.21.15.100:0/3648572389 >> v2:172.21.15.12:3300/0 conn(0x7fc92c0c9be0 msgr2=0x7fc92c0c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 --2- 172.21.15.100:0/3648572389 >> v2:172.21.15.12:3300/0 conn(0x7fc92c0c9be0 0x7fc92c0c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92b7fe640 1 -- 172.21.15.100:0/3648572389 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c070ac0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.304+0000 7fc92affd640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc92b7fe640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c0cf520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc92c15bc70 tx=0x7fc92402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b770eac7cecaff2b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc929ffb640 1 -- 172.21.15.100:0/3648572389 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924007740 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc929ffb640 1 -- 172.21.15.100:0/3648572389 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9240078e0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc929ffb640 1 -- 172.21.15.100:0/3648572389 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924007cb0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 -- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 msgr2=0x7fc92c0cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c0cf520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc92c15bc70 tx=0x7fc92402a660 comp rx=0 tx=0).stop 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 -- 172.21.15.100:0/3648572389 shutdown_connections 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c0cf520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3648572389 >> v2:172.21.15.12:3300/0 conn(0x7fc92c0c9be0 0x7fc92c0c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3648572389 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c155e70 0x7fc92c0c4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 -- 172.21.15.100:0/3648572389 >> 172.21.15.100:0/3648572389 conn(0x7fc92c068090 msgr2=0x7fc92c068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 -- 172.21.15.100:0/3648572389 shutdown_connections 2024-04-26T17:57:51.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.305+0000 7fc9312a0640 1 -- 172.21.15.100:0/3648572389 wait complete. 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 Processor -- start 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 -- start start 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 0x7fc92c14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc92c155e70 0x7fc92c0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c15c300 con 0x7fc92c155e70 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c15c020 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc9312a0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c070e90 con 0x7fc92c0c9be0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92affd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 0x7fc92c14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92a7fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39068/0 (socket says 172.21.15.100:39068) 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92a7fc640 1 -- 172.21.15.100:0/3096592978 learned_addr learned my addr 172.21.15.100:0/3096592978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92affd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 0x7fc92c14f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34508/0 (socket says 172.21.15.100:34508) 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.307+0000 7fc92b7fe640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc92c155e70 0x7fc92c0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 -- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 msgr2=0x7fc92c14f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 0x7fc92c14f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 -- 172.21.15.100:0/3096592978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc92c155e70 msgr2=0x7fc92c0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc92c155e70 0x7fc92c0cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 -- 172.21.15.100:0/3096592978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c0cc1f0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc92a7fc640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e8f0 tx=0x7fc92000edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc920017070 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92000c940 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c0cba30 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92000cd10 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c1f1f80 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc92001a070 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.308+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc92001ca70 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.309+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c076d20 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.311+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc92001c4f0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.383+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0de27771-aa00-462a-b1db-c1fe635d3d2a", "id": 5} v 0) -- 0x7fc92c0711c0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.383 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.383+0000 7f333c412040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:57:51.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.389+0000 7fc9137fe640 1 -- 172.21.15.100:0/3096592978 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0de27771-aa00-462a-b1db-c1fe635d3d2a", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc92001c7a0 con 0x7fc92c0cf0f0 2024-04-26T17:57:51.389 INFO:teuthology.orchestra.run.smithi100.stdout:5 2024-04-26T17:57:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 msgr2=0x7fc92c1f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc92000e8f0 tx=0x7fc92000edb0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 shutdown_connections 2024-04-26T17:57:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc92c155e70 0x7fc92c0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc92c0cf0f0 0x7fc92c1f5df0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 --2- 172.21.15.100:0/3096592978 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc92c0c9be0 0x7fc92c14f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 >> 172.21.15.100:0/3096592978 conn(0x7fc92c068090 msgr2=0x7fc92c071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 shutdown_connections 2024-04-26T17:57:51.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.390+0000 7fc9312a0640 1 -- 172.21.15.100:0/3096592978 wait complete. 2024-04-26T17:57:51.399 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.399+0000 7ff53c8a1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T17:57:51.400 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new 4c45c193-312c-48f1-9a12-92b2bc39aa9d 6 2024-04-26T17:57:51.436 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.436+0000 7f333c412040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:57:51.454 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.454+0000 7ff53c8a1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T17:57:51.492 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.492+0000 7f333c412040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:57:51.509 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.509+0000 7ff53c8a1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T17:57:51.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.532+0000 7f1383772640 1 Processor -- start 2024-04-26T17:57:51.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.532+0000 7f1383772640 1 -- start start 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1383772640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f137c0c6210 0x7f137c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1383772640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 0x7f137c0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1383772640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c0ca490 con 0x7f137c071ad0 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1383772640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f137c0cbfa0 con 0x7f137c0c6210 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1383772640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0cb2b0 con 0x7f137c0ca8c0 2024-04-26T17:57:51.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1381d0f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 0x7f137c0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f138150e640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f137c071ad0 0x7f137c0c9d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52130/0 (socket says 172.21.15.100:52130) 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f138150e640 1 -- 172.21.15.100:0/1959801584 learned_addr learned my addr 172.21.15.100:0/1959801584 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1380d0d640 1 --2- 172.21.15.100:0/1959801584 >> v2:172.21.15.12:3300/0 conn(0x7f137c0c6210 0x7f137c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1373fff640 1 -- 172.21.15.100:0/1959801584 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215091426 0 0) 0x7f137c0ca490 con 0x7f137c071ad0 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1373fff640 1 -- 172.21.15.100:0/1959801584 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1368003520 con 0x7f137c071ad0 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1381d0f640 1 -- 172.21.15.100:0/1959801584 >> v2:172.21.15.12:3300/0 conn(0x7f137c0c6210 msgr2=0x7f137c071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1381d0f640 1 --2- 172.21.15.100:0/1959801584 >> v2:172.21.15.12:3300/0 conn(0x7f137c0c6210 0x7f137c071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1381d0f640 1 -- 172.21.15.100:0/1959801584 >> v1:172.21.15.100:6789/0 conn(0x7f137c071ad0 legacy=0x7f137c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.533+0000 7f1381d0f640 1 -- 172.21.15.100:0/1959801584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c0cb8e0 con 0x7f137c0ca8c0 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.534+0000 7f1381d0f640 1 --2- 172.21.15.100:0/1959801584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 0x7f137c0cad70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=522082866031e938 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.534+0000 7f1373fff640 1 -- 172.21.15.100:0/1959801584 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374007740 con 0x7f137c0ca8c0 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.534+0000 7f1373fff640 1 -- 172.21.15.100:0/1959801584 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13740078e0 con 0x7f137c0ca8c0 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.534+0000 7f1373fff640 1 -- 172.21.15.100:0/1959801584 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374007cb0 con 0x7f137c0ca8c0 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 -- 172.21.15.100:0/1959801584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 msgr2=0x7f137c0cad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 --2- 172.21.15.100:0/1959801584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 0x7f137c0cad70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137402a660 comp rx=0 tx=0).stop 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 -- 172.21.15.100:0/1959801584 shutdown_connections 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 --2- 172.21.15.100:0/1959801584 >> v2:172.21.15.12:3300/0 conn(0x7f137c0c6210 0x7f137c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 --2- 172.21.15.100:0/1959801584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0ca8c0 0x7f137c0cad70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 -- 172.21.15.100:0/1959801584 >> 172.21.15.100:0/1959801584 conn(0x7f137c0746d0 msgr2=0x7f137c076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 -- 172.21.15.100:0/1959801584 shutdown_connections 2024-04-26T17:57:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.535+0000 7f1383772640 1 -- 172.21.15.100:0/1959801584 wait complete. 2024-04-26T17:57:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.536+0000 7f1383772640 1 Processor -- start 2024-04-26T17:57:51.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.536+0000 7f1383772640 1 -- start start 2024-04-26T17:57:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c071ad0 0x7f137c153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f137c0ca8c0 0x7f137c1f36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cc4d0 con 0x7f137c071ad0 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f137c0cc1f0 con 0x7f137c0ca8c0 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0cc7b0 con 0x7f137c0c6210 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34520/0 (socket says 172.21.15.100:34520) 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 -- 172.21.15.100:0/3829016054 learned_addr learned my addr 172.21.15.100:0/3829016054 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1381d0f640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f137c0ca8c0 0x7f137c1f36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f138150e640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c071ad0 0x7f137c153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 -- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f137c0ca8c0 msgr2=0x7f137c1f36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f137c0ca8c0 0x7f137c1f36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 -- 172.21.15.100:0/3829016054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c071ad0 msgr2=0x7f137c153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c071ad0 0x7f137c153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 -- 172.21.15.100:0/3829016054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c0cd890 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1380d0d640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f136c00e9b0 tx=0x7f136c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c017070 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c00c9a0 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c0cf7a0 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.537+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c00cd70 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.538+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c0cfd60 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.538+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f136c01a070 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.538+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f136c01cae0 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.538+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c069ae0 con 0x7f137c0c6210 2024-04-26T17:57:51.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.540+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f136c01c4f0 con 0x7f137c0c6210 2024-04-26T17:57:51.609 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:51.609+0000 7f333c412040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:51.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.612+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c45c193-312c-48f1-9a12-92b2bc39aa9d", "id": 6} v 0) -- 0x7f137c076d20 con 0x7f137c0c6210 2024-04-26T17:57:51.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.617+0000 7f1371ffb640 1 -- 172.21.15.100:0/3829016054 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c45c193-312c-48f1-9a12-92b2bc39aa9d", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f136c01c800 con 0x7f137c0c6210 2024-04-26T17:57:51.618 INFO:teuthology.orchestra.run.smithi100.stdout:6 2024-04-26T17:57:51.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 msgr2=0x7f137c1f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f136c00e9b0 tx=0x7f136c00ee70 comp rx=0 tx=0).stop 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 shutdown_connections 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f137c0ca8c0 0x7f137c1f36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f137c0c6210 0x7f137c1f31a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 --2- 172.21.15.100:0/3829016054 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f137c071ad0 0x7f137c153fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.618+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 >> 172.21.15.100:0/3829016054 conn(0x7f137c0746d0 msgr2=0x7f137c149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.619+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 shutdown_connections 2024-04-26T17:57:51.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.619+0000 7f1383772640 1 -- 172.21.15.100:0/3829016054 wait complete. 2024-04-26T17:57:51.627 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:51.628+0000 7ff53c8a1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T17:57:51.629 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd new ca17a682-4f39-444f-8dcb-1bf4b65c17d4 7 2024-04-26T17:57:51.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 Processor -- start 2024-04-26T17:57:51.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 -- start start 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f159c0caba0 0x7f159c0caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c1563b0 con 0x7f159c06cb20 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159c15f930 con 0x7f159c06c4a0 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.726+0000 7f15a2b97640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f159c15c670 con 0x7f159c0caba0 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159bfff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f159c06c4a0 0x7f159c15f220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:52146/0 (socket says 172.21.15.100:52146) 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159bfff640 1 -- 172.21.15.100:0/3557751667 learned_addr learned my addr 172.21.15.100:0/3557751667 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f15a0933640 1 --2- 172.21.15.100:0/3557751667 >> v2:172.21.15.12:3300/0 conn(0x7f159c0caba0 0x7f159c0caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225773950 0 0) 0x7f159c15f930 con 0x7f159c06c4a0 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f158c003520 con 0x7f159c06c4a0 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835947951 0 0) 0x7f159c1563b0 con 0x7f159c06cb20 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f159c15f930 con 0x7f159c06cb20 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f15a0933640 1 -- 172.21.15.100:0/3557751667 >> v1:172.21.15.100:6789/0 conn(0x7f159c06c4a0 legacy=0x7f159c15f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f15a0933640 1 -- 172.21.15.100:0/3557751667 >> v1:172.21.15.12:6789/0 conn(0x7f159c06cb20 legacy=0x7f159c1665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.727+0000 7f15a0933640 1 -- 172.21.15.100:0/3557751667 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c0b0f60 con 0x7f159c0caba0 2024-04-26T17:57:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a0933640 1 --2- 172.21.15.100:0/3557751667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c0caba0 0x7f159c0caf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15900097a0 tx=0x7f159002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb0176cdce553a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590037070 con 0x7f159c0caba0 2024-04-26T17:57:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1590032640 con 0x7f159c0caba0 2024-04-26T17:57:51.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f159b7fe640 1 -- 172.21.15.100:0/3557751667 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900329f0 con 0x7f159c0caba0 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a2b97640 1 -- 172.21.15.100:0/3557751667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c0caba0 msgr2=0x7f159c0caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a2b97640 1 --2- 172.21.15.100:0/3557751667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c0caba0 0x7f159c0caf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f15900097a0 tx=0x7f159002a2c0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a2b97640 1 -- 172.21.15.100:0/3557751667 shutdown_connections 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a2b97640 1 --2- 172.21.15.100:0/3557751667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c0caba0 0x7f159c0caf80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.728+0000 7f15a2b97640 1 -- 172.21.15.100:0/3557751667 >> 172.21.15.100:0/3557751667 conn(0x7f159c070a50 msgr2=0x7f159c070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.729+0000 7f15a2b97640 1 -- 172.21.15.100:0/3557751667 shutdown_connections 2024-04-26T17:57:51.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.729+0000 7f15a2b97640 1 -- 172.21.15.100:0/3557751667 wait complete. 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 Processor -- start 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 -- start start 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 0x7f159c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f159c15c020 con 0x7f159c06c4a0 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f159c15bd40 con 0x7f159c0caba0 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.730+0000 7f15a2b97640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f159c15c300 con 0x7f159c06cb20 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a1134640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a1134640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39076/0 (socket says 172.21.15.100:39076) 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:34522/0 (socket says 172.21.15.100:34522) 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a1134640 1 -- 172.21.15.100:0/1167729475 learned_addr learned my addr 172.21.15.100:0/1167729475 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-04-26T17:57:51.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a0933640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 0x7f159c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 -- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 msgr2=0x7f159c1f2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 -- 172.21.15.100:0/1167729475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 msgr2=0x7f159c0c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 0x7f159c0c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 -- 172.21.15.100:0/1167729475 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c15b090 con 0x7f159c06cb20 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a0933640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 0x7f159c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a1134640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f159bfff640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f158800c3e0 tx=0x7f158800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588017070 con 0x7f159c06cb20 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1588005ce0 con 0x7f159c06cb20 2024-04-26T17:57:51.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c15cfe0 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880072d0 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c15b610 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f158801a070 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.731+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f158801cc90 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.733+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159c076d20 con 0x7f159c06cb20 2024-04-26T17:57:51.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.734+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1588007470 con 0x7f159c06cb20 2024-04-26T17:57:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.823+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ca17a682-4f39-444f-8dcb-1bf4b65c17d4", "id": 7} v 0) -- 0x7f159c074770 con 0x7f159c06cb20 2024-04-26T17:57:51.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.831+0000 7f15997fa640 1 -- 172.21.15.100:0/1167729475 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca17a682-4f39-444f-8dcb-1bf4b65c17d4", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f158801c440 con 0x7f159c06cb20 2024-04-26T17:57:51.831 INFO:teuthology.orchestra.run.smithi100.stdout:7 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 msgr2=0x7f159c1f2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f158800c3e0 tx=0x7f158800c8a0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 shutdown_connections 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f159c0caba0 0x7f159c1f2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f159c06cb20 0x7f159c1f2610 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 --2- 172.21.15.100:0/1167729475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f159c06c4a0 0x7f159c0c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 >> 172.21.15.100:0/1167729475 conn(0x7f159c070a50 msgr2=0x7f159c151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 shutdown_connections 2024-04-26T17:57:51.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-04-26T17:57:51.832+0000 7f15a2b97640 1 -- 172.21.15.100:0/1167729475 wait complete. 2024-04-26T17:57:51.842 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T17:57:51.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T17:57:51.844 INFO:tasks.ceph.osd.0:Started 2024-04-26T17:57:51.844 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T17:57:51.844 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T17:57:51.846 INFO:tasks.ceph.osd.1:Started 2024-04-26T17:57:51.846 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T17:57:51.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T17:57:51.848 INFO:tasks.ceph.osd.2:Started 2024-04-26T17:57:51.849 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-26T17:57:51.849 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-26T17:57:51.851 INFO:tasks.ceph.osd.3:Started 2024-04-26T17:57:51.851 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-26T17:57:51.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-26T17:57:51.853 INFO:tasks.ceph.osd.4:Started 2024-04-26T17:57:51.853 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-26T17:57:51.853 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-26T17:57:51.855 INFO:tasks.ceph.osd.5:Started 2024-04-26T17:57:51.855 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-26T17:57:51.856 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-26T17:57:51.857 INFO:tasks.ceph.osd.6:Started 2024-04-26T17:57:51.858 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-26T17:57:51.858 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-26T17:57:51.860 INFO:tasks.ceph.osd.7:Started 2024-04-26T17:57:51.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.984+0000 7fb169008640 1 Processor -- start 2024-04-26T17:57:51.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.984+0000 7fb169008640 1 -- start start 2024-04-26T17:57:51.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb169008640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb164156180 0x7fb16415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb169008640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1640cd840 0x7fb1640c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb169008640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb16415f2a0 con 0x7fb164155da0 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb169008640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb16415cbc0 con 0x7fb1640cd840 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb169008640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb1640cc730 con 0x7fb164156180 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1640cd840 0x7fb1640c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1640cd840 0x7fb1640c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43340/0 (socket says 172.21.15.12:43340) 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 -- 172.21.15.12:0/3873625781 learned_addr learned my addr 172.21.15.12:0/3873625781 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16259c640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb164156180 0x7fb16415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 -- 172.21.15.12:0/3873625781 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb164156180 msgr2=0x7fb16415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb164156180 0x7fb16415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 -- 172.21.15.12:0/3873625781 >> v1:172.21.15.100:6789/0 conn(0x7fb164155da0 legacy=0x7fb1640d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:51.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.985+0000 7fb16359e640 1 -- 172.21.15.12:0/3873625781 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb16415f580 con 0x7fb1640cd840 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.986+0000 7fb16359e640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb1640c62a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009e50 tx=0x7fb15c02a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f812a42d3f83afd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.986+0000 7fb161d9b640 1 -- 172.21.15.12:0/3873625781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c036070 con 0x7fb1640cd840 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.986+0000 7fb161d9b640 1 -- 172.21.15.12:0/3873625781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c031600 con 0x7fb1640cd840 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.986+0000 7fb161d9b640 1 -- 172.21.15.12:0/3873625781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb15c0319d0 con 0x7fb1640cd840 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 -- 172.21.15.12:0/3873625781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 msgr2=0x7fb1640c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb1640c62a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009e50 tx=0x7fb15c02a630 comp rx=0 tx=0).stop 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 -- 172.21.15.12:0/3873625781 shutdown_connections 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb1640c62a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 --2- 172.21.15.12:0/3873625781 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb164156180 0x7fb16415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 -- 172.21.15.12:0/3873625781 >> 172.21.15.12:0/3873625781 conn(0x7fb164068090 msgr2=0x7fb1640684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:51.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 -- 172.21.15.12:0/3873625781 shutdown_connections 2024-04-26T17:57:51.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.987+0000 7fb169008640 1 -- 172.21.15.12:0/3873625781 wait complete. 2024-04-26T17:57:51.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.988+0000 7fb169008640 1 Processor -- start 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.988+0000 7fb169008640 1 -- start start 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb164155da0 0x7fb1641f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1641e4fd0 0x7fb1640d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb1640d19d0 con 0x7fb1640cd840 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb16415fb40 con 0x7fb164155da0 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb169008640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb1640d1b50 con 0x7fb1641e4fd0 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb162d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb162d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43344/0 (socket says 172.21.15.12:43344) 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb162d9d640 1 -- 172.21.15.12:0/2107567056 learned_addr learned my addr 172.21.15.12:0/2107567056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb16259c640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb164155da0 0x7fb1641f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.989+0000 7fb16359e640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1641e4fd0 0x7fb1640d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:51.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 -- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1641e4fd0 msgr2=0x7fb1640d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1641e4fd0 0x7fb1640d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 -- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb164155da0 msgr2=0x7fb1641f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb164155da0 0x7fb1641f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 -- 172.21.15.12:0/2107567056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb164159dd0 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb162d9d640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c430 tx=0x7fb15800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158011790 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb158017070 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb158011bb0 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16415a0b0 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb16415a670 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb15801c460 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.990+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fb158011d50 con 0x7fb1640cd840 2024-04-26T17:57:51.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.991+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb164076d20 con 0x7fb1640cd840 2024-04-26T17:57:51.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:51.993+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb158012790 con 0x7fb1640cd840 2024-04-26T17:57:52.053 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.053+0000 7f333c412040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:57:52.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.056+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1640cd330 con 0x7fb1640cd840 2024-04-26T17:57:52.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.056+0000 7fb14b7fe640 1 -- 172.21.15.12:0/2107567056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fb158012a20 con 0x7fb1640cd840 2024-04-26T17:57:52.056 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:57:52.057 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:57:51.824943+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 msgr2=0x7fb16415bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb15800c430 tx=0x7fb15800c8f0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 shutdown_connections 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb1641e4fd0 0x7fb1640d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb164155da0 0x7fb1641f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 --2- 172.21.15.12:0/2107567056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1640cd840 0x7fb16415bcd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 >> 172.21.15.12:0/2107567056 conn(0x7fb164068090 msgr2=0x7fb164153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 shutdown_connections 2024-04-26T17:57:52.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:57:52.057+0000 7fb169008640 1 -- 172.21.15.12:0/2107567056 wait complete. 2024-04-26T17:57:52.067 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.067+0000 7ff53c8a1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-26T17:57:52.068 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T17:57:52.069 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T17:57:52.311 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.311+0000 7f333c412040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:57:52.340 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.340+0000 7ff53c8a1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T17:57:52.362 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.362+0000 7f333c412040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:57:52.395 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.395+0000 7ff53c8a1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T17:57:52.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-04-26T17:57:52.463+0000 7fa1cd215640 -1 Falling back to public interface 2024-04-26T17:57:52.465 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-04-26T17:57:52.466+0000 7f628540c640 -1 Falling back to public interface 2024-04-26T17:57:52.466 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:57:52.466+0000 7f9cb8ef0640 -1 Falling back to public interface 2024-04-26T17:57:52.466 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:57:52.466+0000 7f9cb7e9f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-26T17:57:52.466 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:57:52.466+0000 7f9cb7e9f640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-04-26T17:57:52.470 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-04-26T17:57:52.470+0000 7f157db44640 -1 Falling back to public interface 2024-04-26T17:57:52.470 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-04-26T17:57:52.470+0000 7fe42e411640 -1 Falling back to public interface 2024-04-26T17:57:52.471 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-04-26T17:57:52.470+0000 7f1cfea2c640 -1 Falling back to public interface 2024-04-26T17:57:52.471 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-04-26T17:57:52.471+0000 7f1cfd9db640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2024-04-26T17:57:52.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-04-26T17:57:52.472+0000 7fabc7ddc640 -1 Falling back to public interface 2024-04-26T17:57:52.479 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.480+0000 7f333c412040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:57:52.484 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-04-26T17:57:52.484+0000 7f1863b2c640 -1 Falling back to public interface 2024-04-26T17:57:52.525 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.525+0000 7ff53c8a1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-26T17:57:52.762 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.762+0000 7f333c412040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:57:52.810 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.810+0000 7f333c412040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:57:52.820 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.820+0000 7ff53c8a1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T17:57:52.871 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:52.870+0000 7ff53c8a1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T17:57:52.874 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:52.965 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:52.965+0000 7f333c412040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:57:52.966 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.966+0000 7f03e1c7b640 1 Processor -- start 2024-04-26T17:57:52.966 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.966+0000 7f03e1c7b640 1 -- start start 2024-04-26T17:57:52.967 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03e1c7b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03dc0b2de0 0x7f03dc15d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:52.967 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03e1c7b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:52.967 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03e1c7b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03dc070b10 con 0x7f03dc15aa80 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03e1c7b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f03dc071060 con 0x7f03dc0b2de0 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03e1c7b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc071920 con 0x7f03dc0b4570 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03daffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03dc0b2de0 0x7f03dc15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03db7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f03dc15aa80 0x7f03dc0cf360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:45762/0 (socket says 172.21.15.12:45762) 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03daffd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f03dc0b2de0 0x7f03dc15d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:41084/0 (socket says 172.21.15.12:41084) 2024-04-26T17:57:52.968 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.967+0000 7f03db7fe640 1 -- 172.21.15.12:0/3384616445 learned_addr learned my addr 172.21.15.12:0/3384616445 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03daffd640 1 -- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 msgr2=0x7f03dc15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03daffd640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc15dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03daffd640 1 -- 172.21.15.12:0/3384616445 >> v1:172.21.15.100:6789/0 conn(0x7f03dc15aa80 legacy=0x7f03dc0cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03daffd640 1 -- 172.21.15.12:0/3384616445 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc070d80 con 0x7f03dc0b2de0 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03da7fc640 1 -- 172.21.15.12:0/3384616445 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727336220 0 0) 0x7f03dc070b10 con 0x7f03dc15aa80 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03dbfff640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.968+0000 7f03daffd640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc0b2de0 0x7f03dc15d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d204826204093e3e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03da7fc640 1 -- 172.21.15.12:0/3384616445 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4037070 con 0x7f03dc0b2de0 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03da7fc640 1 -- 172.21.15.12:0/3384616445 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c4032440 con 0x7f03dc0b2de0 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03da7fc640 1 -- 172.21.15.12:0/3384616445 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c4032810 con 0x7f03dc0b2de0 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 -- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc0b2de0 msgr2=0x7f03dc15d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:52.970 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc0b2de0 0x7f03dc15d790 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03c40097a0 tx=0x7f03c402a210 comp rx=0 tx=0).stop 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 -- 172.21.15.12:0/3384616445 shutdown_connections 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc0b2de0 0x7f03dc15d790 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/3384616445 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 -- 172.21.15.12:0/3384616445 >> 172.21.15.12:0/3384616445 conn(0x7f03dc071e30 msgr2=0x7f03dc072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 -- 172.21.15.12:0/3384616445 shutdown_connections 2024-04-26T17:57:52.971 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.969+0000 7f03e1c7b640 1 -- 172.21.15.12:0/3384616445 wait complete. 2024-04-26T17:57:52.973 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.970+0000 7f03e1c7b640 1 Processor -- start 2024-04-26T17:57:52.973 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 -- start start 2024-04-26T17:57:52.973 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 0x7f03dc1f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:52.973 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:52.973 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 0x7f03dc06e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc0c9870 con 0x7f03dc0b2de0 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc0c9590 con 0x7f03dc15aa80 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03e1c7b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc0c9cf0 con 0x7f03dc0b4570 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 0x7f03dc1f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03dbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 0x7f03dc06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 0x7f03dc1f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60318/0 (socket says 172.21.15.12:60318) 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03db7fe640 1 -- 172.21.15.12:0/2403408762 learned_addr learned my addr 172.21.15.12:0/2403408762 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.971+0000 7f03daffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 -- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 msgr2=0x7f03dc06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 -- 172.21.15.12:0/2403408762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 msgr2=0x7f03dc1f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 0x7f03dc1f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 -- 172.21.15.12:0/2403408762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc06d510 con 0x7f03dc15aa80 2024-04-26T17:57:52.974 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03dbfff640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 0x7f03dc06e210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009e50 tx=0x7f03d400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4018030 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d400cd90 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4003bb0 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc1f5510 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc15a0c0 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03d401b070 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.972+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f03d4014b50 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.973+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc0506c0 con 0x7f03dc15aa80 2024-04-26T17:57:52.975 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:52.975+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f03d4010040 con 0x7f03dc15aa80 2024-04-26T17:57:53.038 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.038+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03dc1f46c0 con 0x7f03dc15aa80 2024-04-26T17:57:53.038 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.038+0000 7f03d3fff640 1 -- 172.21.15.12:0/2403408762 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f03d4014480 con 0x7f03dc15aa80 2024-04-26T17:57:53.039 INFO:teuthology.misc.health.smithi012.stdout: 2024-04-26T17:57:53.039 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:57:51.824943+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 msgr2=0x7f03dc06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 0x7f03dc06e210 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009e50 tx=0x7f03d400c490 comp rx=0 tx=0).stop 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 shutdown_connections 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f03dc15aa80 0x7f03dc06e210 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f03dc0b4570 0x7f03dc06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:53.040 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 --2- 172.21.15.12:0/2403408762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f03dc0b2de0 0x7f03dc1f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:57:53.041 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 >> 172.21.15.12:0/2403408762 conn(0x7f03dc071e30 msgr2=0x7f03dc15d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:57:53.041 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 shutdown_connections 2024-04-26T17:57:53.041 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:57:53.040+0000 7f03e1c7b640 1 -- 172.21.15.12:0/2403408762 wait complete. 2024-04-26T17:57:53.041 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.041+0000 7ff53c8a1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T17:57:53.053 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T17:57:53.103 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.103+0000 7f333c412040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:57:53.152 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.153+0000 7f333c412040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:57:53.190 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.190+0000 7ff53c8a1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T17:57:53.221 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.222+0000 7f333c412040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:53.242 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.242+0000 7ff53c8a1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T17:57:53.267 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.267+0000 7f333c412040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:57:53.316 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.316+0000 7ff53c8a1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T17:57:53.364 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.364+0000 7ff53c8a1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T17:57:53.744 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.744+0000 7f333c412040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:57:53.860 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:53.860+0000 7f333c412040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:57:53.870 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.870+0000 7ff53c8a1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T17:57:53.994 INFO:tasks.ceph.mgr.y.smithi012.stderr:2024-04-26T17:57:53.994+0000 7ff53c8a1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T17:57:54.876 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:54.876+0000 7f32dc453640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T17:57:54.876 INFO:tasks.ceph.mgr.x.smithi100.stderr:2024-04-26T17:57:54.876+0000 7f32dc453640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T17:57:55.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-04-26T17:57:55.951+0000 7fabc7ddc640 -1 osd.1 0 log_to_monitors true 2024-04-26T17:57:55.976 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-04-26T17:57:55.976+0000 7f157db44640 -1 osd.7 0 log_to_monitors true 2024-04-26T17:57:55.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-04-26T17:57:55.977+0000 7fa1cd215640 -1 osd.0 0 log_to_monitors true 2024-04-26T17:57:55.985 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-04-26T17:57:55.985+0000 7fe42e411640 -1 osd.3 0 log_to_monitors true 2024-04-26T17:57:55.993 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-04-26T17:57:55.993+0000 7f1cfea2c640 -1 osd.2 0 log_to_monitors true 2024-04-26T17:57:56.004 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:57:56.004+0000 7f9cb8ef0640 -1 osd.5 0 log_to_monitors true 2024-04-26T17:57:56.007 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-04-26T17:57:56.007+0000 7f628540c640 -1 osd.4 0 log_to_monitors true 2024-04-26T17:57:56.008 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-04-26T17:57:56.008+0000 7f1863b2c640 -1 osd.6 0 log_to_monitors true 2024-04-26T17:57:59.860 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:57:59.993 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-04-26T17:57:59.992+0000 7fe429cf3640 -1 osd.3 0 waiting for initial osdmap 2024-04-26T17:58:00.002 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:58:00.001+0000 7f9cb4e86640 -1 osd.5 0 waiting for initial osdmap 2024-04-26T17:58:00.005 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-04-26T17:58:00.005+0000 7f1cfa9c2640 -1 osd.2 0 waiting for initial osdmap 2024-04-26T17:58:00.006 INFO:tasks.ceph.osd.3.smithi012.stderr:2024-04-26T17:58:00.006+0000 7fe421b13640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-04-26T17:58:00.009+0000 7fabc3d72640 -1 osd.1 0 waiting for initial osdmap 2024-04-26T17:58:00.013 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.013+0000 7f5e23452640 1 Processor -- start 2024-04-26T17:58:00.013 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.013+0000 7f5e23452640 1 -- start start 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e23452640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e1c150290 0x7f5e1c15ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e23452640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c074560 0x7f5e1c164310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e23452640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e1c070680 con 0x7f5e1c071010 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e23452640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5e1c15a4b0 con 0x7f5e1c150290 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e23452640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1c0703e0 con 0x7f5e1c074560 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e211ee640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e1c150290 0x7f5e1c15ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e209ed640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e1c071010 0x7f5e1c0c70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46766/0 (socket says 172.21.15.12:46766) 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e209ed640 1 -- 172.21.15.12:0/2925148147 learned_addr learned my addr 172.21.15.12:0/2925148147 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e219ef640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c074560 0x7f5e1c164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.016 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e13fff640 1 -- 172.21.15.12:0/2925148147 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609857821 0 0) 0x7f5e1c070680 con 0x7f5e1c071010 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e13fff640 1 -- 172.21.15.12:0/2925148147 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e08003520 con 0x7f5e1c071010 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e211ee640 1 -- 172.21.15.12:0/2925148147 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c074560 msgr2=0x7f5e1c164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e211ee640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c074560 0x7f5e1c164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e211ee640 1 -- 172.21.15.12:0/2925148147 >> v1:172.21.15.12:6789/0 conn(0x7f5e1c071010 legacy=0x7f5e1c0c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.014+0000 7f5e211ee640 1 -- 172.21.15.12:0/2925148147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1c072ff0 con 0x7f5e1c150290 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.015+0000 7f5e211ee640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c15ae80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097a0 tx=0x7f5e1802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470bcd0d13583c3b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.016+0000 7f5e13fff640 1 -- 172.21.15.12:0/2925148147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18037070 con 0x7f5e1c150290 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.016+0000 7f5e13fff640 1 -- 172.21.15.12:0/2925148147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e18032440 con 0x7f5e1c150290 2024-04-26T17:58:00.017 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.016+0000 7f5e13fff640 1 -- 172.21.15.12:0/2925148147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18032810 con 0x7f5e1c150290 2024-04-26T17:58:00.018 INFO:tasks.ceph.osd.5.smithi100.stderr:2024-04-26T17:58:00.016+0000 7f9cacca6640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.018 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-04-26T17:58:00.016+0000 7f1579ada640 -1 osd.7 0 waiting for initial osdmap 2024-04-26T17:58:00.019 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.016+0000 7f5e23452640 1 -- 172.21.15.12:0/2925148147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 msgr2=0x7f5e1c15ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.019 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c15ae80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5e180097a0 tx=0x7f5e1802a180 comp rx=0 tx=0).stop 2024-04-26T17:58:00.019 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 -- 172.21.15.12:0/2925148147 shutdown_connections 2024-04-26T17:58:00.020 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c074560 0x7f5e1c164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.020 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 --2- 172.21.15.12:0/2925148147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c15ae80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.020 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 -- 172.21.15.12:0/2925148147 >> 172.21.15.12:0/2925148147 conn(0x7f5e1c06c320 msgr2=0x7f5e1c06c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:00.020 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 -- 172.21.15.12:0/2925148147 shutdown_connections 2024-04-26T17:58:00.020 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.017+0000 7f5e23452640 1 -- 172.21.15.12:0/2925148147 wait complete. 2024-04-26T17:58:00.020 INFO:tasks.ceph.osd.2.smithi012.stderr:2024-04-26T17:58:00.018+0000 7f1cf27e2640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.019+0000 7f5e23452640 1 Processor -- start 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.019+0000 7f5e23452640 1 -- start start 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c071010 0x7f5e1c0c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e1c074560 0x7f5e1c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e209ed640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e1c074560 0x7f5e1c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60358/0 (socket says 172.21.15.12:60358) 2024-04-26T17:58:00.023 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1c0740d0 con 0x7f5e1c150290 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 -- 172.21.15.12:0/1222230031 learned_addr learned my addr 172.21.15.12:0/1222230031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1c072ad0 con 0x7f5e1c074560 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e211ee640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c071010 0x7f5e1c0c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1c153fa0 con 0x7f5e1c071010 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 -- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c071010 msgr2=0x7f5e1c0c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c071010 0x7f5e1c0c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 -- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e1c074560 msgr2=0x7f5e1c156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e1c074560 0x7f5e1c156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.020+0000 7f5e219ef640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1c156e30 con 0x7f5e1c150290 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e219ef640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dd0 tx=0x7f5e1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14018020 con 0x7f5e1c150290 2024-04-26T17:58:00.024 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1c1570d0 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e14014480 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e14014870 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.021+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1c14dd00 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.022+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f5e14005d10 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.022+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e1c0506c0 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.023+0000 7f5e11ffb640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 0x7f5e0006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.023+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f5e1408b8b0 con 0x7f5e1c150290 2024-04-26T17:58:00.025 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.023+0000 7f5e211ee640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 0x7f5e0006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:00.026 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.023+0000 7f5e211ee640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 0x7f5e0006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:00.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2024-04-26T17:58:00.025+0000 7fabbbb92640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.027 INFO:tasks.ceph.osd.7.smithi100.stderr:2024-04-26T17:58:00.028+0000 7f15718fa640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.028 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.028+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5e14022030 con 0x7f5e1c150290 2024-04-26T17:58:00.040 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-04-26T17:58:00.040+0000 7f6280ccf640 -1 osd.4 0 waiting for initial osdmap 2024-04-26T17:58:00.054 INFO:tasks.ceph.osd.4.smithi100.stderr:2024-04-26T17:58:00.055+0000 7f6278aef640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-04-26T17:58:00.062+0000 7fa1c8afb640 -1 osd.0 0 waiting for initial osdmap 2024-04-26T17:58:00.064 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-04-26T17:58:00.064+0000 7f185fac2640 -1 osd.6 0 waiting for initial osdmap 2024-04-26T17:58:00.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2024-04-26T17:58:00.076+0000 7fa1c091b640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.080 INFO:tasks.ceph.osd.6.smithi100.stderr:2024-04-26T17:58:00.080+0000 7f18578e2640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T17:58:00.217 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.216+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5e1c15dd90 con 0x7f5e1c150290 2024-04-26T17:58:00.217 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.217+0000 7f5e11ffb640 1 -- 172.21.15.12:0/1222230031 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f5e14010040 con 0x7f5e1c150290 2024-04-26T17:58:00.217 INFO:teuthology.misc.health.smithi012.stdout: 2024-04-26T17:58:00.217 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":12,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:57:57.875660+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:00.219 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 msgr2=0x7f5e0006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 0x7f5e0006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5e18034000 tx=0x7f5e1802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 msgr2=0x7f5e1c154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dd0 tx=0x7f5e1400c490 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 shutdown_connections 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e1c150290 0x7f5e1c154c50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e1c074560 0x7f5e1c156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f5e0006c860 0x7f5e0006ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 --2- 172.21.15.12:0/1222230031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5e1c071010 0x7f5e1c0c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:00.220 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 >> 172.21.15.12:0/1222230031 conn(0x7f5e1c06c320 msgr2=0x7f5e1c15cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:00.221 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 shutdown_connections 2024-04-26T17:58:00.221 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:00.219+0000 7f5e23452640 1 -- 172.21.15.12:0/1222230031 wait complete. 2024-04-26T17:58:00.229 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-26T17:58:07.037 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:07.141 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.141+0000 7ff6636c4640 1 Processor -- start 2024-04-26T17:58:07.142 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff6636c4640 1 -- start start 2024-04-26T17:58:07.144 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff6636c4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff65c155e70 0x7ff65c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.144 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff6636c4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c15f6b0 con 0x7ff65c156250 2024-04-26T17:58:07.144 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff6636c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff65c15f990 con 0x7ff65c06c3b0 2024-04-26T17:58:07.144 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff6636c4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7ff65c06e950 con 0x7ff65c155e70 2024-04-26T17:58:07.144 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.142+0000 7ff661c61640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff65c156250 0x7ff65c075870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47506/0 (socket says 172.21.15.12:47506) 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff661c61640 1 -- 172.21.15.12:0/930855315 learned_addr learned my addr 172.21.15.12:0/930855315 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff661460640 1 --2- 172.21.15.12:0/930855315 >> v2:172.21.15.100:3300/0 conn(0x7ff65c155e70 0x7ff65c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110867676 0 0) 0x7ff65c15f6b0 con 0x7ff65c156250 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff648003520 con 0x7ff65c156250 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351847317 0 0) 0x7ff65c15f990 con 0x7ff65c06c3b0 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff65c15f6b0 con 0x7ff65c06c3b0 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff661460640 1 -- 172.21.15.12:0/930855315 >> v1:172.21.15.100:6789/0 conn(0x7ff65c06c3b0 legacy=0x7ff65c06ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff661460640 1 -- 172.21.15.12:0/930855315 >> v1:172.21.15.12:6789/0 conn(0x7ff65c156250 legacy=0x7ff65c075870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.143+0000 7ff661460640 1 -- 172.21.15.12:0/930855315 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c15fc70 con 0x7ff65c155e70 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.144+0000 7ff661460640 1 --2- 172.21.15.12:0/930855315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c155e70 0x7ff65c15bd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6580097a0 tx=0x7ff65802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15719599d263642a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.144+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658037070 con 0x7ff65c155e70 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.144+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65802ab90 con 0x7ff65c155e70 2024-04-26T17:58:07.145 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.144+0000 7ff653fff640 1 -- 172.21.15.12:0/930855315 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540019f0 con 0x7ff65c155e70 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 -- 172.21.15.12:0/930855315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c155e70 msgr2=0x7ff65c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 --2- 172.21.15.12:0/930855315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c155e70 0x7ff65c15bd80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff6580097a0 tx=0x7ff65802a100 comp rx=0 tx=0).stop 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 -- 172.21.15.12:0/930855315 shutdown_connections 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 --2- 172.21.15.12:0/930855315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c155e70 0x7ff65c15bd80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 -- 172.21.15.12:0/930855315 >> 172.21.15.12:0/930855315 conn(0x7ff65c070b60 msgr2=0x7ff65c070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.150 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 -- 172.21.15.12:0/930855315 shutdown_connections 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.145+0000 7ff6636c4640 1 -- 172.21.15.12:0/930855315 wait complete. 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.146+0000 7ff6636c4640 1 Processor -- start 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.146+0000 7ff6636c4640 1 -- start start 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c06c3b0 0x7ff65c153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff65c156250 0x7ff65c15b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c15f370 con 0x7ff65c155e70 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff65c160230 con 0x7ff65c06c3b0 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff6636c4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff65c06f4f0 con 0x7ff65c156250 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54634/0 (socket says 172.21.15.12:54634) 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 -- 172.21.15.12:0/3301648928 learned_addr learned my addr 172.21.15.12:0/3301648928 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff661c61640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff65c156250 0x7ff65c15b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.151 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 -- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff65c156250 msgr2=0x7ff65c15b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff661460640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c06c3b0 0x7ff65c153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff65c156250 0x7ff65c15b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 -- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c06c3b0 msgr2=0x7ff65c153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c06c3b0 0x7ff65c153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 -- 172.21.15.12:0/3301648928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65c0cc550 con 0x7ff65c155e70 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff660c5f640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c530 tx=0x7ff64c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c0052d0 con 0x7ff65c155e70 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.147+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64c005490 con 0x7ff65c155e70 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.148+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65c14c640 con 0x7ff65c155e70 2024-04-26T17:58:07.152 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.148+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c012870 con 0x7ff65c155e70 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.148+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff65c0cdd30 con 0x7ff65c155e70 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.149+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65c0506c0 con 0x7ff65c155e70 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.149+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff64c012a10 con 0x7ff65c155e70 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.150+0000 7ff651ffb640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 0x7ff64006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.150+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff64c08b4d0 con 0x7ff65c155e70 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.150+0000 7ff661460640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 0x7ff64006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.153 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.150+0000 7ff661460640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 0x7ff64006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff658034000 tx=0x7ff65802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.154 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.155+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff65c0cc550 con 0x7ff65c155e70 2024-04-26T17:58:07.340 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.340+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff65c0c55e0 con 0x7ff65c155e70 2024-04-26T17:58:07.341 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.341+0000 7ff651ffb640 1 -- 172.21.15.12:0/3301648928 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7ff64c059580 con 0x7ff65c155e70 2024-04-26T17:58:07.341 INFO:teuthology.misc.health.smithi012.stdout: 2024-04-26T17:58:07.342 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":16,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:04.009570+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 msgr2=0x7ff64006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 0x7ff64006edb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff658034000 tx=0x7ff65802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 msgr2=0x7ff65c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff64c00c530 tx=0x7ff64c00c9f0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 shutdown_connections 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff64006c8f0 0x7ff64006edb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff65c156250 0x7ff65c15b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff65c155e70 0x7ff65c15e920 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 --2- 172.21.15.12:0/3301648928 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff65c06c3b0 0x7ff65c153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 >> 172.21.15.12:0/3301648928 conn(0x7ff65c070b60 msgr2=0x7ff65c0c9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.344 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 shutdown_connections 2024-04-26T17:58:07.345 INFO:teuthology.misc.health.smithi012.stderr:2024-04-26T17:58:07.343+0000 7ff6636c4640 1 -- 172.21.15.12:0/3301648928 wait complete. 2024-04-26T17:58:07.353 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-26T17:58:07.353 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T17:58:07.354 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T17:58:07.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T17:58:07.356 INFO:tasks.ceph.mds.a:Started 2024-04-26T17:58:07.356 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-26T17:58:07.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-26T17:58:07.358 INFO:tasks.ceph.mds.c:Started 2024-04-26T17:58:07.359 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-26T17:58:07.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-26T17:58:07.363 INFO:tasks.ceph.mds.e:Started 2024-04-26T17:58:07.363 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-26T17:58:07.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-26T17:58:07.366 INFO:tasks.ceph.mds.b:Started 2024-04-26T17:58:07.367 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-26T17:58:07.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-26T17:58:07.369 INFO:tasks.ceph.mds.d:Started 2024-04-26T17:58:07.369 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-26T17:58:07.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-26T17:58:07.371 INFO:tasks.ceph.mds.f:Started 2024-04-26T17:58:07.371 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T17:58:07.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:07.434 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2024-04-26T17:58:07.435 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2024-04-26T17:58:07.441 INFO:tasks.ceph.mds.f.smithi100.stdout:starting mds.f at 2024-04-26T17:58:07.442 INFO:tasks.ceph.mds.d.smithi100.stdout:starting mds.d at 2024-04-26T17:58:07.442 INFO:tasks.ceph.mds.e.smithi012.stdout:starting mds.e at 2024-04-26T17:58:07.443 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2024-04-26T17:58:07.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.481+0000 7f081dbaf640 1 Processor -- start 2024-04-26T17:58:07.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.481+0000 7f081dbaf640 1 -- start start 2024-04-26T17:58:07.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f081dbaf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0818155da0 0x7f081815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f081dbaf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0818156180 0x7f08180d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f081dbaf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f081815f2a0 con 0x7f08180cd840 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f081dbaf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f081815cbc0 con 0x7f0818155da0 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f081dbaf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f08180cc730 con 0x7f0818156180 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0818155da0 0x7f081815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0818155da0 0x7f081815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54678/0 (socket says 172.21.15.12:54678) 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 -- 172.21.15.12:0/4177766995 learned_addr learned my addr 172.21.15.12:0/4177766995 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f0816ffd640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0818156180 0x7f08180d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 -- 172.21.15.12:0/4177766995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0818156180 msgr2=0x7f08180d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0818156180 0x7f08180d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 -- 172.21.15.12:0/4177766995 >> v1:172.21.15.100:6789/0 conn(0x7f08180cd840 legacy=0x7f08180c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.482+0000 7f08177fe640 1 -- 172.21.15.12:0/4177766995 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081815f580 con 0x7f0818155da0 2024-04-26T17:58:07.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f08177fe640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f081815c680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0808009870 tx=0x7f080802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b618a63940324119 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f08167fc640 1 -- 172.21.15.12:0/4177766995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808037070 con 0x7f0818155da0 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f08167fc640 1 -- 172.21.15.12:0/4177766995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808032440 con 0x7f0818155da0 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f08167fc640 1 -- 172.21.15.12:0/4177766995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808032810 con 0x7f0818155da0 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 -- 172.21.15.12:0/4177766995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 msgr2=0x7f081815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f081815c680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0808009870 tx=0x7f080802a1c0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 -- 172.21.15.12:0/4177766995 shutdown_connections 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0818156180 0x7f08180d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 --2- 172.21.15.12:0/4177766995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f081815c680 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.483+0000 7f081dbaf640 1 -- 172.21.15.12:0/4177766995 >> 172.21.15.12:0/4177766995 conn(0x7f0818068090 msgr2=0x7f08180684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.484+0000 7f081dbaf640 1 -- 172.21.15.12:0/4177766995 shutdown_connections 2024-04-26T17:58:07.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.484+0000 7f081dbaf640 1 -- 172.21.15.12:0/4177766995 wait complete. 2024-04-26T17:58:07.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.485+0000 7f081dbaf640 1 Processor -- start 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.485+0000 7f081dbaf640 1 -- start start 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f08180cd840 0x7f08181f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 0x7f08180c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f08180c69b0 con 0x7f0818155da0 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f081815fb40 con 0x7f08181512c0 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f081dbaf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f08180c6b30 con 0x7f08180cd840 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54688/0 (socket says 172.21.15.12:54688) 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 -- 172.21.15.12:0/2345545 learned_addr learned my addr 172.21.15.12:0/2345545 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f08177fe640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f08180cd840 0x7f08181f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0817fff640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 0x7f08180c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 -- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f08180cd840 msgr2=0x7f08181f2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f08180cd840 0x7f08181f2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 -- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 msgr2=0x7f08180c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 0x7f08180c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0816ffd640 1 -- 172.21.15.12:0/2345545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0818151b80 con 0x7f0818155da0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.486+0000 7f0817fff640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 0x7f08180c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f0816ffd640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f080000e9e0 tx=0x7f080000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800017070 con 0x7f0818155da0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f080000c9d0 con 0x7f0818155da0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08181f1af0 con 0x7f0818155da0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080000cdc0 con 0x7f0818155da0 2024-04-26T17:58:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.487+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08181f5df0 con 0x7f0818155da0 2024-04-26T17:58:07.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.488+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081814c870 con 0x7f0818155da0 2024-04-26T17:58:07.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.488+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f080001a070 con 0x7f0818155da0 2024-04-26T17:58:07.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.489+0000 7f080ffff640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 0x7f07f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:07.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.489+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f080008b790 con 0x7f0818155da0 2024-04-26T17:58:07.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.489+0000 7f08177fe640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 0x7f07f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:07.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.489+0000 7f08177fe640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 0x7f07f806ede0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:07.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.493+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08000598c0 con 0x7f0818155da0 2024-04-26T17:58:07.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.715+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0818076d20 con 0x7f0818155da0 2024-04-26T17:58:07.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.715+0000 7f080ffff640 1 -- 172.21.15.12:0/2345545 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f080005dbc0 con 0x7f0818155da0 2024-04-26T17:58:07.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:07.716 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-26T17:58:07.716 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 2 2024-04-26T17:58:07.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 msgr2=0x7f07f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 0x7f07f806ede0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0808034000 tx=0x7f080802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:07.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 msgr2=0x7f08181f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f080000e9e0 tx=0x7f080000eea0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 shutdown_connections 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08181512c0 0x7f08180c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0818155da0 0x7f08181f25b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f07f806c920 0x7f07f806ede0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 --2- 172.21.15.12:0/2345545 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f08180cd840 0x7f08181f2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 >> 172.21.15.12:0/2345545 conn(0x7f0818068090 msgr2=0x7f08180ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 shutdown_connections 2024-04-26T17:58:07.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:07.717+0000 7f081dbaf640 1 -- 172.21.15.12:0/2345545 wait complete. 2024-04-26T17:58:09.729 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.842+0000 7f1b33d04640 1 Processor -- start 2024-04-26T17:58:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.842+0000 7f1b33d04640 1 -- start start 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2c157120 0x7f1b2c06faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c068090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b2c0685d0 0x7f1b2c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2c070030 con 0x7f1b2c157120 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2c157500 con 0x7f1b2c0685d0 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b33d04640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2c15d090 con 0x7f1b2c0c8b10 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b31aa0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2c157120 0x7f1b2c06faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b31aa0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b2c157120 0x7f1b2c06faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54698/0 (socket says 172.21.15.12:54698) 2024-04-26T17:58:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.843+0000 7f1b31aa0640 1 -- 172.21.15.12:0/1247719354 learned_addr learned my addr 172.21.15.12:0/1247719354 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b322a1640 1 --2- 172.21.15.12:0/1247719354 >> v2:172.21.15.100:3300/0 conn(0x7f1b2c0685d0 0x7f1b2c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b3129f640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 -- 172.21.15.12:0/1247719354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 msgr2=0x7f1b2c068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c068090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 -- 172.21.15.12:0/1247719354 >> v2:172.21.15.100:3300/0 conn(0x7f1b2c0685d0 msgr2=0x7f1b2c159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/1247719354 >> v2:172.21.15.100:3300/0 conn(0x7f1b2c0685d0 0x7f1b2c159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 -- 172.21.15.12:0/1247719354 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c15d330 con 0x7f1b2c157120 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b3129f640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.844+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c06faf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b0720 tx=0x7f1b1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59d8a921d758baf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b30a9e640 1 -- 172.21.15.12:0/1247719354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c037070 con 0x7f1b2c157120 2024-04-26T17:58:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b30a9e640 1 -- 172.21.15.12:0/1247719354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c032440 con 0x7f1b2c157120 2024-04-26T17:58:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b30a9e640 1 -- 172.21.15.12:0/1247719354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c032810 con 0x7f1b2c157120 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 -- 172.21.15.12:0/1247719354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 msgr2=0x7f1b2c06faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c06faf0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0b0720 tx=0x7f1b1c02a270 comp rx=0 tx=0).stop 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 -- 172.21.15.12:0/1247719354 shutdown_connections 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 --2- 172.21.15.12:0/1247719354 >> v2:172.21.15.100:3300/0 conn(0x7f1b2c0685d0 0x7f1b2c159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 --2- 172.21.15.12:0/1247719354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c06faf0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 -- 172.21.15.12:0/1247719354 >> 172.21.15.12:0/1247719354 conn(0x7f1b2c0ce110 msgr2=0x7f1b2c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 -- 172.21.15.12:0/1247719354 shutdown_connections 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.845+0000 7f1b33d04640 1 -- 172.21.15.12:0/1247719354 wait complete. 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.846+0000 7f1b33d04640 1 Processor -- start 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 -- start start 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b2c0685d0 0x7f1b2c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c070250 con 0x7f1b2c157120 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c15d8f0 con 0x7f1b2c0685d0 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b33d04640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2c0c8f30 con 0x7f1b2c0c8b10 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b322a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b322a1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54712/0 (socket says 172.21.15.12:54712) 2024-04-26T17:58:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b322a1640 1 -- 172.21.15.12:0/2001659854 learned_addr learned my addr 172.21.15.12:0/2001659854 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b2c0685d0 0x7f1b2c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.847+0000 7f1b3129f640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 -- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 msgr2=0x7f1b2c14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c14f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 -- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b2c0685d0 msgr2=0x7f1b2c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b2c0685d0 0x7f1b2c0c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 -- 172.21.15.12:0/2001659854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c1f06d0 con 0x7f1b2c157120 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b322a1640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400ef00 tx=0x7f1b2400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24018020 con 0x7f1b2c157120 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b24014400 con 0x7f1b2c157120 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c151760 con 0x7f1b2c157120 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b240147f0 con 0x7f1b2c157120 2024-04-26T17:58:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.848+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c151d20 con 0x7f1b2c157120 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.849+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2c06fe50 con 0x7f1b2c157120 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.850+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b24005d10 con 0x7f1b2c157120 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.850+0000 7f1b2a7fc640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.850+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1b2408bcb0 con 0x7f1b2c157120 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.850+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:09.853 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.851+0000 7f1b31aa0640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 0x7f1b1806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c034000 tx=0x7f1b1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:09.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:09.855+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b2c06fe50 con 0x7f1b2c157120 2024-04-26T17:58:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.077+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1b2c076d20 con 0x7f1b2c157120 2024-04-26T17:58:10.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.077+0000 7f1b2a7fc640 1 -- 172.21.15.12:0/2001659854 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7f1b24022070 con 0x7f1b2c157120 2024-04-26T17:58:10.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:10.078 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4300,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-26T17:58:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 msgr2=0x7f1b1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 0x7f1b1806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c034000 tx=0x7f1b1c02e000 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 msgr2=0x7f1b2c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400ef00 tx=0x7f1b2400b480 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 shutdown_connections 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b2c157120 0x7f1b2c0c7250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b1806c8f0 0x7f1b1806edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b2c0c8b10 0x7f1b2c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 --2- 172.21.15.12:0/2001659854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b2c0685d0 0x7f1b2c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 >> 172.21.15.12:0/2001659854 conn(0x7f1b2c0ce110 msgr2=0x7f1b2c072f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 shutdown_connections 2024-04-26T17:58:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.079+0000 7f1b33d04640 1 -- 172.21.15.12:0/2001659854 wait complete. 2024-04-26T17:58:10.091 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T17:58:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.192+0000 7f0ebe91c640 1 Processor -- start 2024-04-26T17:58:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.192+0000 7f0ebe91c640 1 -- start start 2024-04-26T17:58:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebe91c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 0x7f0eb80c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebe91c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0eb815c460 0x7f0eb8068b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebe91c640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb80c95e0 con 0x7f0eb80686f0 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebe91c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb80c98c0 con 0x7f0eb815c460 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebe91c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb80c9ba0 con 0x7f0eb8152850 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0eb7fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 0x7f0eb80c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebceb9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0eb815c460 0x7f0eb8068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebceb9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0eb815c460 0x7f0eb8068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:37402/0 (socket says 172.21.15.12:37402) 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.193+0000 7f0ebceb9640 1 -- 172.21.15.12:0/854245775 learned_addr learned my addr 172.21.15.12:0/854245775 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0ebceb9640 1 -- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 msgr2=0x7f0eb80c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0ebceb9640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 0x7f0eb80c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0ebceb9640 1 -- 172.21.15.12:0/854245775 >> v1:172.21.15.100:6789/0 conn(0x7f0eb80686f0 legacy=0x7f0eb815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0ebceb9640 1 -- 172.21.15.12:0/854245775 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb80caab0 con 0x7f0eb815c460 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0eb6ffd640 1 -- 172.21.15.12:0/854245775 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539921837 0 0) 0x7f0eb80c95e0 con 0x7f0eb80686f0 2024-04-26T17:58:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0eb7fff640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 0x7f0eb80c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:10.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0ebceb9640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb815c460 0x7f0eb8068b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e50 tx=0x7f0eb002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987ce106fb4208fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0eb6ffd640 1 -- 172.21.15.12:0/854245775 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0036070 con 0x7f0eb815c460 2024-04-26T17:58:10.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.194+0000 7f0eb6ffd640 1 -- 172.21.15.12:0/854245775 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb0031600 con 0x7f0eb815c460 2024-04-26T17:58:10.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0eb6ffd640 1 -- 172.21.15.12:0/854245775 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00319d0 con 0x7f0eb815c460 2024-04-26T17:58:10.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 -- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb815c460 msgr2=0x7f0eb8068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb815c460 0x7f0eb8068b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e50 tx=0x7f0eb002a730 comp rx=0 tx=0).stop 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 -- 172.21.15.12:0/854245775 shutdown_connections 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb815c460 0x7f0eb8068b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/854245775 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb8152850 0x7f0eb80c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 -- 172.21.15.12:0/854245775 >> 172.21.15.12:0/854245775 conn(0x7f0eb80730d0 msgr2=0x7f0eb80734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 -- 172.21.15.12:0/854245775 shutdown_connections 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.195+0000 7f0ebe91c640 1 -- 172.21.15.12:0/854245775 wait complete. 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.196+0000 7f0ebe91c640 1 Processor -- start 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.196+0000 7f0ebe91c640 1 -- start start 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb80686f0 0x7f0eb814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb8152850 0x7f0eb8153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb80c9190 con 0x7f0eb815c460 2024-04-26T17:58:10.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb80cade0 con 0x7f0eb8152850 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebe91c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb80cb2b0 con 0x7f0eb80686f0 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54728/0 (socket says 172.21.15.12:54728) 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 -- 172.21.15.12:0/3786837462 learned_addr learned my addr 172.21.15.12:0/3786837462 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0eb7fff640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb80686f0 0x7f0eb814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0eb77fe640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb8152850 0x7f0eb8153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 -- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb80686f0 msgr2=0x7f0eb814a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb80686f0 0x7f0eb814a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 -- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb8152850 msgr2=0x7f0eb8153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb8152850 0x7f0eb8153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.197+0000 7f0ebceb9640 1 -- 172.21.15.12:0/3786837462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb81564d0 con 0x7f0eb815c460 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0ebceb9640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0034040 tx=0x7f0eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb003f020 con 0x7f0eb815c460 2024-04-26T17:58:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb0037040 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb8156770 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0036070 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.198+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb8156a30 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.199+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb815cb50 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.199+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0eb0042020 con 0x7f0eb815c460 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.200+0000 7f0eb4ff9640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 0x7f0ea406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.200+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0eb00abc00 con 0x7f0eb815c460 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.200+0000 7f0eb7fff640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 0x7f0ea406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.200+0000 7f0eb7fff640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 0x7f0ea406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009560 tx=0x7f0ea8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.204+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0eb815cb50 con 0x7f0eb815c460 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.389+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0eb81512e0 con 0x7f0eb815c460 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.390+0000 7f0eb4ff9640 1 -- 172.21.15.12:0/3786837462 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f0eb81512e0 con 0x7f0eb815c460 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: { 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2024-04-26T17:58:10.390 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:58:10.391 INFO:teuthology.orchestra.run.smithi012.stdout:] 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 msgr2=0x7f0ea406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 0x7f0ea406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009560 tx=0x7f0ea8008040 comp rx=0 tx=0).stop 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 msgr2=0x7f0eb81f1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0034040 tx=0x7f0eb0004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 shutdown_connections 2024-04-26T17:58:10.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb815c460 0x7f0eb81f1960 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb8152850 0x7f0eb8153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ea406c8f0 0x7f0ea406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 --2- 172.21.15.12:0/3786837462 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0eb80686f0 0x7f0eb814a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 >> 172.21.15.12:0/3786837462 conn(0x7f0eb80730d0 msgr2=0x7f0eb8075870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 shutdown_connections 2024-04-26T17:58:10.393 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.392+0000 7f0ebe91c640 1 -- 172.21.15.12:0/3786837462 wait complete. 2024-04-26T17:58:10.402 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T17:58:10.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T17:58:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.507+0000 7f3f460ea640 1 Processor -- start 2024-04-26T17:58:10.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f460ea640 1 -- start start 2024-04-26T17:58:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f460ea640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f401529e0 0x7f3f400c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f460ea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f400c8c10 con 0x7f3f400cb840 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f460ea640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f400c5b00 con 0x7f3f400c5630 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f460ea640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3f4015be50 con 0x7f3f401529e0 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f3ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3f400cb840 0x7f3f4015c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47536/0 (socket says 172.21.15.12:47536) 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.508+0000 7f3f3ffff640 1 -- 172.21.15.12:0/14706881 learned_addr learned my addr 172.21.15.12:0/14706881 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/14706881 >> v2:172.21.15.100:3300/0 conn(0x7f3f401529e0 0x7f3f400c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2942874817 0 0) 0x7f3f400c8c10 con 0x7f3f400cb840 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f28005730 con 0x7f3f400cb840 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654727703 0 0) 0x7f3f400c5b00 con 0x7f3f400c5630 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f400c8c10 con 0x7f3f400c5630 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2847092316 0 0) 0x7f3f28005730 con 0x7f3f400cb840 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 >> v2:172.21.15.100:3300/0 conn(0x7f3f401529e0 msgr2=0x7f3f400c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 --2- 172.21.15.12:0/14706881 >> v2:172.21.15.100:3300/0 conn(0x7f3f401529e0 0x7f3f400c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 >> v1:172.21.15.100:6789/0 conn(0x7f3f400c5630 legacy=0x7f3f4006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400c7500 con 0x7f3f400cb840 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f3f380019f0 con 0x7f3f400cb840 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 >> v1:172.21.15.12:6789/0 conn(0x7f3f400cb840 legacy=0x7f3f4015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f28005d50 0x7f3f28006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f28006a10 0x7f3f28006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 0x7f3f2800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4015be50 con 0x7f3f280073d0 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2800e1c0 con 0x7f3f28006a10 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2800e3c0 con 0x7f3f28005d50 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3ffff640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 0x7f3f2800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3effd640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f28006a10 0x7f3f28006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.509+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f28005d50 0x7f3f28006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 -- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f28005d50 msgr2=0x7f3f28006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f28005d50 0x7f3f28006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 -- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f28006a10 msgr2=0x7f3f28006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f28006a10 0x7f3f28006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 -- 172.21.15.12:0/14706881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f28005730 con 0x7f3f280073d0 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 -- 172.21.15.12:0/14706881 reap_dead start 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3ffff640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 0x7f3f2800dbd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a7e0 tx=0x7f3f28007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e9830db592d0c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3800a430 con 0x7f3f280073d0 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3802f070 con 0x7f3f280073d0 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.510+0000 7f3f3e7fc640 1 -- 172.21.15.12:0/14706881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3802bc20 con 0x7f3f280073d0 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 -- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 msgr2=0x7f3f2800dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 0x7f3f2800dbd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3f3800a7e0 tx=0x7f3f28007a40 comp rx=0 tx=0).stop 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 -- 172.21.15.12:0/14706881 shutdown_connections 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 --2- 172.21.15.12:0/14706881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f280073d0 0x7f3f2800dbd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 -- 172.21.15.12:0/14706881 >> 172.21.15.12:0/14706881 conn(0x7f3f400730d0 msgr2=0x7f3f400734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 -- 172.21.15.12:0/14706881 shutdown_connections 2024-04-26T17:58:10.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.511+0000 7f3f460ea640 1 -- 172.21.15.12:0/14706881 wait complete. 2024-04-26T17:58:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.512+0000 7f3f460ea640 1 Processor -- start 2024-04-26T17:58:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.512+0000 7f3f460ea640 1 -- start start 2024-04-26T17:58:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 0x7f3f401565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f401514c0 0x7f3f400cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400c7200 con 0x7f3f4014e320 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400c7ac0 con 0x7f3f280073d0 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f460ea640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3f40152dc0 con 0x7f3f401514c0 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54736/0 (socket says 172.21.15.12:54736) 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 -- 172.21.15.12:0/1938271933 learned_addr learned my addr 172.21.15.12:0/1938271933 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 0x7f3f401565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3ffff640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f401514c0 0x7f3f400cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 -- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f401514c0 msgr2=0x7f3f400cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f401514c0 0x7f3f400cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 -- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 msgr2=0x7f3f401565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 0x7f3f401565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3effd640 1 -- 172.21.15.12:0/1938271933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f40151ff0 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.513+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 0x7f3f401565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f3effd640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f820 tx=0x7f3f3400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3401a070 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f34005110 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f34007050 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4014d900 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.514+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4014dec0 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.515+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f40076d20 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.515+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3f3401d070 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.516+0000 7f3f27fff640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.516+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f3f3408b100 con 0x7f3f4014e320 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.516+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.517+0000 7f3f3f7fe640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009a40 tx=0x7f3f30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:10.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.520+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3f340597f0 con 0x7f3f4014e320 2024-04-26T17:58:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:10.702+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3f40156280 con 0x7f3f4014e320 2024-04-26T17:58:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.467+0000 7f3f27fff640 1 -- 172.21.15.12:0/1938271933 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f3f340590f0 con 0x7f3f4014e320 2024-04-26T17:58:11.468 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.470+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 msgr2=0x7f3f2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.470+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009a40 tx=0x7f3f30008040 comp rx=0 tx=0).stop 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.470+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 msgr2=0x7f3f401f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.470+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f3400f820 tx=0x7f3f3400fce0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 shutdown_connections 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3f2c06c8f0 0x7f3f2c06edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3f401514c0 0x7f3f400cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f4014e320 0x7f3f401f4fa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 --2- 172.21.15.12:0/1938271933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f280073d0 0x7f3f401565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 >> 172.21.15.12:0/1938271933 conn(0x7f3f400730d0 msgr2=0x7f3f400ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 shutdown_connections 2024-04-26T17:58:11.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.471+0000 7f3f460ea640 1 -- 172.21.15.12:0/1938271933 wait complete. 2024-04-26T17:58:11.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-26T17:58:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.602+0000 7f2c641e6640 1 Processor -- start 2024-04-26T17:58:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.602+0000 7f2c641e6640 1 -- start start 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c641e6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c5c0d1320 0x7f2c5c0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c641e6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5c15cbc0 con 0x7f2c5c1527f0 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c641e6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5c15c040 con 0x7f2c5c0cc0e0 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c641e6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2c5c0c6780 con 0x7f2c5c0d1320 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61781640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c5c0d1320 0x7f2c5c0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61f82640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c5c1527f0 0x7f2c5c15f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47542/0 (socket says 172.21.15.12:47542) 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61f82640 1 -- 172.21.15.12:0/99471097 learned_addr learned my addr 172.21.15.12:0/99471097 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61781640 1 -- 172.21.15.12:0/99471097 >> v1:172.21.15.100:6789/0 conn(0x7f2c5c0cc0e0 legacy=0x7f2c5c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61781640 1 -- 172.21.15.12:0/99471097 >> v1:172.21.15.12:6789/0 conn(0x7f2c5c1527f0 legacy=0x7f2c5c15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.603+0000 7f2c61781640 1 -- 172.21.15.12:0/99471097 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c15c320 con 0x7f2c5c0d1320 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.604+0000 7f2c61781640 1 --2- 172.21.15.12:0/99471097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c0d17b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c500097c0 tx=0x7f2c5002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbe4362017d5daf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.604+0000 7f2c60f80640 1 -- 172.21.15.12:0/99471097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50037070 con 0x7f2c5c0d1320 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.604+0000 7f2c60f80640 1 -- 172.21.15.12:0/99471097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c50032440 con 0x7f2c5c0d1320 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.604+0000 7f2c60f80640 1 -- 172.21.15.12:0/99471097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50032810 con 0x7f2c5c0d1320 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 -- 172.21.15.12:0/99471097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c0d1320 msgr2=0x7f2c5c0d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 --2- 172.21.15.12:0/99471097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c0d17b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2c500097c0 tx=0x7f2c5002a200 comp rx=0 tx=0).stop 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 -- 172.21.15.12:0/99471097 shutdown_connections 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 --2- 172.21.15.12:0/99471097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c0d17b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 -- 172.21.15.12:0/99471097 >> 172.21.15.12:0/99471097 conn(0x7f2c5c076100 msgr2=0x7f2c5c073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:11.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 -- 172.21.15.12:0/99471097 shutdown_connections 2024-04-26T17:58:11.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.605+0000 7f2c641e6640 1 -- 172.21.15.12:0/99471097 wait complete. 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.606+0000 7f2c641e6640 1 Processor -- start 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.606+0000 7f2c641e6640 1 -- start start 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2c5c0cc0e0 0x7f2c5c1f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c0cdb00 con 0x7f2c5c1527f0 2024-04-26T17:58:11.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c15c8e0 con 0x7f2c5c0d1320 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c641e6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2c5c15bc70 con 0x7f2c5c0cc0e0 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54750/0 (socket says 172.21.15.12:54750) 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 -- 172.21.15.12:0/1544693356 learned_addr learned my addr 172.21.15.12:0/1544693356 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c61f82640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2c5c0cc0e0 0x7f2c5c1f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c61781640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 -- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2c5c0cc0e0 msgr2=0x7f2c5c1f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2c5c0cc0e0 0x7f2c5c1f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 -- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c5c0d1320 msgr2=0x7f2c5c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 -- 172.21.15.12:0/1544693356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1f5980 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.607+0000 7f2c62783640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c780 tx=0x7f2c4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.608+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c017070 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.608+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c4c003da0 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.608+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c1f5c60 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.608+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c0052b0 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.608+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c0b6560 con 0x7f2c5c1527f0 2024-04-26T17:58:11.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.609+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c076d20 con 0x7f2c5c1527f0 2024-04-26T17:58:11.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.609+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c4c01a070 con 0x7f2c5c1527f0 2024-04-26T17:58:11.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.610+0000 7f2c5a7fc640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 0x7f2c4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:11.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.610+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f2c4c08b040 con 0x7f2c5c1527f0 2024-04-26T17:58:11.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.610+0000 7f2c61f82640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 0x7f2c4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:11.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.611+0000 7f2c61f82640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 0x7f2c4806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000f60 tx=0x7f2c54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:11.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.614+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2c4c059650 con 0x7f2c5c1527f0 2024-04-26T17:58:11.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:11.798+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f2c5c0b4170 con 0x7f2c5c1527f0 2024-04-26T17:58:12.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.472+0000 7f2c5a7fc640 1 -- 172.21.15.12:0/1544693356 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f2c4c058f50 con 0x7f2c5c1527f0 2024-04-26T17:58:12.473 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2024-04-26T17:58:12.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 msgr2=0x7f2c4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 0x7f2c4806edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c54000f60 tx=0x7f2c54009040 comp rx=0 tx=0).stop 2024-04-26T17:58:12.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 msgr2=0x7f2c5c1f4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c00c780 tx=0x7f2c4c00cc40 comp rx=0 tx=0).stop 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 shutdown_connections 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c5c1527f0 0x7f2c5c1f4ed0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2c5c0d1320 0x7f2c5c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c4806c8f0 0x7f2c4806edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 --2- 172.21.15.12:0/1544693356 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2c5c0cc0e0 0x7f2c5c1f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 >> 172.21.15.12:0/1544693356 conn(0x7f2c5c076100 msgr2=0x7f2c5c15af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 shutdown_connections 2024-04-26T17:58:12.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.475+0000 7f2c641e6640 1 -- 172.21.15.12:0/1544693356 wait complete. 2024-04-26T17:58:12.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T17:58:12.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.608+0000 7f4067fc6640 1 Processor -- start 2024-04-26T17:58:12.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 -- start start 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4060153d10 0x7f40600745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f40600737e0 0x7f40600ca530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f40600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f40601540f0 con 0x7f4060153d10 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f40600c8f10 con 0x7f40600737e0 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4067fc6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4060072f20 con 0x7f406006cb10 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4065d62640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4060153d10 0x7f40600745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.609+0000 7f4065d62640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4060153d10 0x7f40600745f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54752/0 (socket says 172.21.15.12:54752) 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 -- 172.21.15.12:0/1483653774 learned_addr learned my addr 172.21.15.12:0/1483653774 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4066563640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f40600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065561640 1 --2- 172.21.15.12:0/1483653774 >> v2:172.21.15.100:3300/0 conn(0x7f40600737e0 0x7f40600ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 -- 172.21.15.12:0/1483653774 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 msgr2=0x7f40600ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f40600ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 -- 172.21.15.12:0/1483653774 >> v2:172.21.15.100:3300/0 conn(0x7f40600737e0 msgr2=0x7f40600ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 --2- 172.21.15.12:0/1483653774 >> v2:172.21.15.100:3300/0 conn(0x7f40600737e0 0x7f40600ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 -- 172.21.15.12:0/1483653774 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40600c8a30 con 0x7f4060153d10 2024-04-26T17:58:12.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4066563640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f40600ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.610+0000 7f4065d62640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060153d10 0x7f40600745f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40600c5240 tx=0x7f405802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04cb3a0b619cfec server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4064d60640 1 -- 172.21.15.12:0/1483653774 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058037070 con 0x7f4060153d10 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4064d60640 1 -- 172.21.15.12:0/1483653774 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058032440 con 0x7f4060153d10 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4064d60640 1 -- 172.21.15.12:0/1483653774 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058032810 con 0x7f4060153d10 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 -- 172.21.15.12:0/1483653774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060153d10 msgr2=0x7f40600745f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060153d10 0x7f40600745f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f40600c5240 tx=0x7f405802a1e0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 -- 172.21.15.12:0/1483653774 shutdown_connections 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f40600ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1483653774 >> v2:172.21.15.100:3300/0 conn(0x7f40600737e0 0x7f40600ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1483653774 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4060153d10 0x7f40600745f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 -- 172.21.15.12:0/1483653774 >> 172.21.15.12:0/1483653774 conn(0x7f406006ed70 msgr2=0x7f406006f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:12.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 -- 172.21.15.12:0/1483653774 shutdown_connections 2024-04-26T17:58:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.611+0000 7f4067fc6640 1 -- 172.21.15.12:0/1483653774 wait complete. 2024-04-26T17:58:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.612+0000 7f4067fc6640 1 Processor -- start 2024-04-26T17:58:12.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.612+0000 7f4067fc6640 1 -- start start 2024-04-26T17:58:12.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f406015c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 0x7f4060159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40600cb6a0 con 0x7f40600737e0 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40600731c0 con 0x7f4060153d10 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4067fc6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f40600cb980 con 0x7f406006cb10 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4065561640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4065561640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54756/0 (socket says 172.21.15.12:54756) 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4065561640 1 -- 172.21.15.12:0/1547794966 learned_addr learned my addr 172.21.15.12:0/1547794966 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4066563640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 0x7f4060159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.613+0000 7f4065d62640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f406015c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 -- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 msgr2=0x7f406015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f406015c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 -- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 msgr2=0x7f4060159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 0x7f4060159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 -- 172.21.15.12:0/1547794966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406014fd10 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4066563640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 0x7f4060159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4065561640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f405400e980 tx=0x7f405400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054017070 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405400ca00 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405400cdd0 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40600c7bf0 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.614+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40601504b0 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.615+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40600cec80 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.615+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f405401a070 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.616+0000 7f405e7fc640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.616+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f405408bb30 con 0x7f40600737e0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.616+0000 7f4065d62640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:12.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.617+0000 7f4065d62640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4058034000 tx=0x7f405802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:12.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.621+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f40600cec80 con 0x7f40600737e0 2024-04-26T17:58:12.844 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:12.843+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f406006f670 con 0x7f40600737e0 2024-04-26T17:58:13.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.474+0000 7f405e7fc640 1 -- 172.21.15.12:0/1547794966 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f406006f670 con 0x7f40600737e0 2024-04-26T17:58:13.474 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.476+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 msgr2=0x7f404c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.476+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4058034000 tx=0x7f405802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.476+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 msgr2=0x7f40601f0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.476+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f405400e980 tx=0x7f405400ee40 comp rx=0 tx=0).stop 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 shutdown_connections 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4060153d10 0x7f4060159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600737e0 0x7f40601f0310 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 --2- 172.21.15.12:0/1547794966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f406006cb10 0x7f406015c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 >> 172.21.15.12:0/1547794966 conn(0x7f406006ed70 msgr2=0x7f40600ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 shutdown_connections 2024-04-26T17:58:13.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.477+0000 7f4067fc6640 1 -- 172.21.15.12:0/1547794966 wait complete. 2024-04-26T17:58:13.507 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-26T17:58:13.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-26T17:58:13.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.618+0000 7fa5648b0640 1 Processor -- start 2024-04-26T17:58:13.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.618+0000 7fa5648b0640 1 -- start start 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa5648b0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa5600cc210 0x7fa5600d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa5648b0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56015f2d0 con 0x7fa560155f30 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa5648b0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa56015f540 con 0x7fa5600cd830 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa5648b0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa56015fe70 con 0x7fa5600cc210 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa55e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa560155f30 0x7fa56015c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56390/0 (socket says 172.21.15.12:56390) 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa55e59c640 1 -- 172.21.15.12:0/101054674 learned_addr learned my addr 172.21.15.12:0/101054674 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa55dd9b640 1 --2- 172.21.15.12:0/101054674 >> v2:172.21.15.100:3300/0 conn(0x7fa5600cc210 0x7fa5600d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319966672 0 0) 0x7fa56015f2d0 con 0x7fa560155f30 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.619+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa548003520 con 0x7fa560155f30 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 942780678 0 0) 0x7fa548003520 con 0x7fa560155f30 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 >> v2:172.21.15.100:3300/0 conn(0x7fa5600cc210 msgr2=0x7fa5600d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 --2- 172.21.15.12:0/101054674 >> v2:172.21.15.100:3300/0 conn(0x7fa5600cc210 0x7fa5600d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 >> v1:172.21.15.100:6789/0 conn(0x7fa5600cd830 legacy=0x7fa5600c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56015f820 con 0x7fa560155f30 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fa558001670 con 0x7fa560155f30 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 >> v1:172.21.15.12:6789/0 conn(0x7fa560155f30 legacy=0x7fa56015c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa56015fe70 con 0x7fa5480051c0 2024-04-26T17:58:13.624 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa54800c060 con 0x7fa5480039b0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa54800c260 con 0x7fa548004800 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55e59c640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55dd9b640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 -- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa548004800 msgr2=0x7fa548004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 -- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5480039b0 msgr2=0x7fa548003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5480039b0 0x7fa548003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55ed9d640 1 -- 172.21.15.12:0/101054674 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa548003520 con 0x7fa5480051c0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.620+0000 7fa55dd9b640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa548004800 0x7fa548004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa55ed9d640 1 -- 172.21.15.12:0/101054674 reap_dead start 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa550001e50 tx=0x7fa548005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760704e9358ca94f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550001a70 con 0x7fa5480051c0 2024-04-26T17:58:13.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa550003970 con 0x7fa5480051c0 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa55d59a640 1 -- 172.21.15.12:0/101054674 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550003d60 con 0x7fa5480051c0 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa5648b0640 1 -- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 msgr2=0x7fa54800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.621+0000 7fa5648b0640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa550001e50 tx=0x7fa548005830 comp rx=0 tx=0).stop 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.622+0000 7fa5648b0640 1 -- 172.21.15.12:0/101054674 shutdown_connections 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.622+0000 7fa5648b0640 1 --2- 172.21.15.12:0/101054674 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5480051c0 0x7fa54800b9c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.622+0000 7fa5648b0640 1 -- 172.21.15.12:0/101054674 >> 172.21.15.12:0/101054674 conn(0x7fa560068090 msgr2=0x7fa5600684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.622+0000 7fa5648b0640 1 -- 172.21.15.12:0/101054674 shutdown_connections 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.622+0000 7fa5648b0640 1 -- 172.21.15.12:0/101054674 wait complete. 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.623+0000 7fa5648b0640 1 Processor -- start 2024-04-26T17:58:13.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.623+0000 7fa5648b0640 1 -- start start 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5480051c0 0x7fa56014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5600b7040 0x7fa56014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa5600cc730 con 0x7fa56014f650 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa560156310 con 0x7fa5600b7040 2024-04-26T17:58:13.629 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa56015c6c0 con 0x7fa5480051c0 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34048/0 (socket says 172.21.15.12:34048) 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 -- 172.21.15.12:0/4237956159 learned_addr learned my addr 172.21.15.12:0/4237956159 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55dd9b640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5600b7040 0x7fa56014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55e59c640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5480051c0 0x7fa56014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 -- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5480051c0 msgr2=0x7fa56014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5480051c0 0x7fa56014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 -- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5600b7040 msgr2=0x7fa56014cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5600b7040 0x7fa56014cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 -- 172.21.15.12:0/4237956159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa560159140 con 0x7fa56014f650 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa55ed9d640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa55002a920 tx=0x7fa5500014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550007db0 con 0x7fa56014f650 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55002ac70 con 0x7fa56014f650 2024-04-26T17:58:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa560159400 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.624+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550001a70 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.625+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5601f1ea0 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.625+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa560076d20 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.626+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa550007030 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.626+0000 7fa54effd640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.626+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fa5500ab500 con 0x7fa56014f650 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.626+0000 7fa55e59c640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.627+0000 7fa55e59c640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 0x7fa54006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f60 tx=0x7fa558000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:13.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.631+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa550043060 con 0x7fa56014f650 2024-04-26T17:58:13.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:13.687 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:13.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:13.826+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fa56015a8c0 con 0x7fa56014f650 2024-04-26T17:58:14.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.476+0000 7fa54effd640 1 -- 172.21.15.12:0/4237956159 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fa550079370 con 0x7fa56014f650 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 msgr2=0x7fa54006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 0x7fa54006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa558000f60 tx=0x7fa558000ed0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 msgr2=0x7fa5600cf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa55002a920 tx=0x7fa5500014a0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 shutdown_connections 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa56014f650 0x7fa5600cf2a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5600b7040 0x7fa56014cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa54006c8f0 0x7fa54006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 --2- 172.21.15.12:0/4237956159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa5480051c0 0x7fa56014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 >> 172.21.15.12:0/4237956159 conn(0x7fa560068090 msgr2=0x7fa5600c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 shutdown_connections 2024-04-26T17:58:14.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.479+0000 7fa5648b0640 1 -- 172.21.15.12:0/4237956159 wait complete. 2024-04-26T17:58:14.493 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T17:58:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.608+0000 7f37f4d9d640 1 Processor -- start 2024-04-26T17:58:14.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.608+0000 7f37f4d9d640 1 -- start start 2024-04-26T17:58:14.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f0155e20 0x7f37f015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37f00c64b0 0x7f37f00c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f00cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f37f0156200 con 0x7f37f0155e20 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f37f00cd550 con 0x7f37f00c64b0 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37f4d9d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37f015c330 con 0x7f37f00c6900 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f0155e20 0x7f37f015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37f0155e20 0x7f37f015bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34056/0 (socket says 172.21.15.12:34056) 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 -- 172.21.15.12:0/2337719235 learned_addr learned my addr 172.21.15.12:0/2337719235 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 -- 172.21.15.12:0/2337719235 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 msgr2=0x7f37f00cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 --2- 172.21.15.12:0/2337719235 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f00cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 -- 172.21.15.12:0/2337719235 >> v2:172.21.15.100:3300/0 conn(0x7f37f00c64b0 msgr2=0x7f37f00c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:14.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 --2- 172.21.15.12:0/2337719235 >> v2:172.21.15.100:3300/0 conn(0x7f37f00c64b0 0x7f37f00c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.609+0000 7f37ee59c640 1 -- 172.21.15.12:0/2337719235 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f015c610 con 0x7f37f0155e20 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.610+0000 7f37ee59c640 1 --2- 172.21.15.12:0/2337719235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0155e20 0x7f37f015bb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37f00cedc0 tx=0x7f37e002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513fa57c0e15a3c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.610+0000 7f37edd9b640 1 -- 172.21.15.12:0/2337719235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0037070 con 0x7f37f0155e20 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.610+0000 7f37edd9b640 1 -- 172.21.15.12:0/2337719235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e0032440 con 0x7f37f0155e20 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.610+0000 7f37edd9b640 1 -- 172.21.15.12:0/2337719235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0032810 con 0x7f37f0155e20 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 -- 172.21.15.12:0/2337719235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0155e20 msgr2=0x7f37f015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/2337719235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0155e20 0x7f37f015bb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f37f00cedc0 tx=0x7f37e002a1e0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.612 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 -- 172.21.15.12:0/2337719235 shutdown_connections 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/2337719235 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f00cc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/2337719235 >> v2:172.21.15.100:3300/0 conn(0x7f37f00c64b0 0x7f37f00c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/2337719235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f0155e20 0x7f37f015bb10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 -- 172.21.15.12:0/2337719235 >> 172.21.15.12:0/2337719235 conn(0x7f37f0072930 msgr2=0x7f37f0072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 -- 172.21.15.12:0/2337719235 shutdown_connections 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.611+0000 7f37f4d9d640 1 -- 172.21.15.12:0/2337719235 wait complete. 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.612+0000 7f37f4d9d640 1 Processor -- start 2024-04-26T17:58:14.613 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.612+0000 7f37f4d9d640 1 -- start start 2024-04-26T17:58:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f01532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f0155e20 0x7f37f0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00c72d0 con 0x7f37f00c64b0 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00c6ff0 con 0x7f37f0155e20 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37f015c050 con 0x7f37f00c6900 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34058/0 (socket says 172.21.15.12:34058) 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 -- 172.21.15.12:0/397772143 learned_addr learned my addr 172.21.15.12:0/397772143 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 -- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 msgr2=0x7f37f01532b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f01532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 -- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f0155e20 msgr2=0x7f37f0153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f0155e20 0x7f37f0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 -- 172.21.15.12:0/397772143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f01f5280 con 0x7f37f00c64b0 2024-04-26T17:58:14.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37ee59c640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37e0000c00 tx=0x7f37e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0041070 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e003c870 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f01f5560 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.613+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0037040 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.614+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f01f5b20 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.615+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f0076d20 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.615+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37e0044070 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.615+0000 7f37e6ffd640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 0x7f37d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.615+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f37e00ac820 con 0x7f37f00c64b0 2024-04-26T17:58:14.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.616+0000 7f37e7fff640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 0x7f37d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:14.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.616+0000 7f37e7fff640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 0x7f37d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37f0154f90 tx=0x7f37d8006bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:14.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.620+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37e007abb0 con 0x7f37f00c64b0 2024-04-26T17:58:14.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:14.807+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f37f00d15e0 con 0x7f37f00c64b0 2024-04-26T17:58:16.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.505+0000 7f37e6ffd640 1 -- 172.21.15.12:0/397772143 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f37e007a4b0 con 0x7f37f00c64b0 2024-04-26T17:58:16.506 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' created 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 msgr2=0x7f37d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 0x7f37d006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f37f0154f90 tx=0x7f37d8006bf0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 msgr2=0x7f37f0152800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f37e0000c00 tx=0x7f37e00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 shutdown_connections 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37f0155e20 0x7f37f0153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37d006c8f0 0x7f37d006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37f00c6900 0x7f37f01532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 --2- 172.21.15.12:0/397772143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37f00c64b0 0x7f37f0152800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 >> 172.21.15.12:0/397772143 conn(0x7f37f0072930 msgr2=0x7f37f00cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 shutdown_connections 2024-04-26T17:58:16.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.509+0000 7f37f4d9d640 1 -- 172.21.15.12:0/397772143 wait complete. 2024-04-26T17:58:16.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-26T17:58:16.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.640+0000 7fb54f6a0640 1 Processor -- start 2024-04-26T17:58:16.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.640+0000 7fb54f6a0640 1 -- start start 2024-04-26T17:58:16.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54f6a0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb5480b6080 0x7fb5480ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54f6a0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5480738c0 con 0x7fb5480ce100 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54f6a0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5480729d0 con 0x7fb5480cc4f0 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54f6a0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb548072cb0 con 0x7fb5480b6080 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54d43c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb5480ce100 0x7fb54815fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56400/0 (socket says 172.21.15.12:56400) 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54d43c640 1 -- 172.21.15.12:0/231481247 learned_addr learned my addr 172.21.15.12:0/231481247 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444304084 0 0) 0x7fb5480738c0 con 0x7fb5480ce100 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb534003520 con 0x7fb5480ce100 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/231481247 >> v2:172.21.15.100:3300/0 conn(0x7fb5480b6080 0x7fb5480ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3579780243 0 0) 0x7fb534003520 con 0x7fb5480ce100 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 >> v2:172.21.15.100:3300/0 conn(0x7fb5480b6080 msgr2=0x7fb5480ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 --2- 172.21.15.12:0/231481247 >> v2:172.21.15.100:3300/0 conn(0x7fb5480b6080 0x7fb5480ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 >> v1:172.21.15.100:6789/0 conn(0x7fb5480cc4f0 legacy=0x7fb5480b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb548072f90 con 0x7fb5480ce100 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fb544001670 con 0x7fb5480ce100 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 >> v1:172.21.15.12:6789/0 conn(0x7fb5480ce100 legacy=0x7fb54815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5340039b0 0x7fb534003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb534004800 0x7fb534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 0x7fb53400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.641+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb548072cb0 con 0x7fb5340051c0 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb53400c160 con 0x7fb5340039b0 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb53400c360 con 0x7fb534004800 2024-04-26T17:58:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54d43c640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5340039b0 0x7fb534003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 0x7fb53400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54cc3b640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb534004800 0x7fb534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 -- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb534004800 msgr2=0x7fb534004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb534004800 0x7fb534004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 -- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5340039b0 msgr2=0x7fb534003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5340039b0 0x7fb534003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.642+0000 7fb54dc3d640 1 -- 172.21.15.12:0/231481247 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb534003520 con 0x7fb5340051c0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54dc3d640 1 -- 172.21.15.12:0/231481247 reap_dead start 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 0x7fb53400b9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb540009fc0 tx=0x7fb534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f7650766375b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540035020 con 0x7fb5340051c0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb540003bd0 con 0x7fb5340051c0 2024-04-26T17:58:16.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb53ffff640 1 -- 172.21.15.12:0/231481247 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540009c10 con 0x7fb5340051c0 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 -- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 msgr2=0x7fb53400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 0x7fb53400b9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb540009fc0 tx=0x7fb534005830 comp rx=0 tx=0).stop 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 -- 172.21.15.12:0/231481247 shutdown_connections 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/231481247 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5340051c0 0x7fb53400b9c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 -- 172.21.15.12:0/231481247 >> 172.21.15.12:0/231481247 conn(0x7fb548068270 msgr2=0x7fb548068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 -- 172.21.15.12:0/231481247 shutdown_connections 2024-04-26T17:58:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.643+0000 7fb54f6a0640 1 -- 172.21.15.12:0/231481247 wait complete. 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 Processor -- start 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 -- start start 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb5340051c0 0x7fb5480c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 0x7fb5480c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb548156360 con 0x7fb54815fdd0 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb548073550 con 0x7fb548158710 2024-04-26T17:58:16.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54f6a0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb5480cd230 con 0x7fb5340051c0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54cc3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54cc3b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34080/0 (socket says 172.21.15.12:34080) 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.645+0000 7fb54cc3b640 1 -- 172.21.15.12:0/1525427271 learned_addr learned my addr 172.21.15.12:0/1525427271 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54d43c640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb5340051c0 0x7fb5480c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 0x7fb5480c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 -- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb5340051c0 msgr2=0x7fb5480c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb5340051c0 0x7fb5480c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 -- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 msgr2=0x7fb5480c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 0x7fb5480c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 -- 172.21.15.12:0/1525427271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5481581c0 con 0x7fb54815fdd0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54dc3d640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 0x7fb5480c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54cc3b640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb53800f620 tx=0x7fb53800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:16.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5380052e0 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb538018070 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5480c8690 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb538003810 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.646+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5480c8c50 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.647+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54808e2b0 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.648+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb5380039b0 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.648+0000 7fb53dffb640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 0x7fb52c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.648+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7fb53808bcb0 con 0x7fb54815fdd0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.648+0000 7fb54d43c640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 0x7fb52c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:16.652 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.649+0000 7fb54d43c640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 0x7fb52c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb544000ff0 tx=0x7fb5440078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:16.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.653+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb54808e2b0 con 0x7fb54815fdd0 2024-04-26T17:58:16.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:16.837+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fb548076d20 con 0x7fb54815fdd0 2024-04-26T17:58:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.510+0000 7fb53dffb640 1 -- 172.21.15.12:0/1525427271 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7fb538059c90 con 0x7fb54815fdd0 2024-04-26T17:58:17.511 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 4 allow_ec_overwrites to true 2024-04-26T17:58:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 msgr2=0x7fb52c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 0x7fb52c06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb544000ff0 tx=0x7fb5440078f0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 msgr2=0x7fb5480c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb53800f620 tx=0x7fb53800fae0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 shutdown_connections 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb548158710 0x7fb5480c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb54815fdd0 0x7fb5480c9840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb52c06c8f0 0x7fb52c06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 --2- 172.21.15.12:0/1525427271 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb5340051c0 0x7fb5480c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 >> 172.21.15.12:0/1525427271 conn(0x7fb548068270 msgr2=0x7fb548151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 shutdown_connections 2024-04-26T17:58:17.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.515+0000 7fb54f6a0640 1 -- 172.21.15.12:0/1525427271 wait complete. 2024-04-26T17:58:17.538 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-26T17:58:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.647+0000 7fbf2bcea640 1 Processor -- start 2024-04-26T17:58:17.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.647+0000 7fbf2bcea640 1 -- start start 2024-04-26T17:58:17.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf2bcea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf240c64b0 0x7fbf240c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf2bcea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf24156200 con 0x7fbf24155e20 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf2bcea640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf240cd550 con 0x7fbf240c6900 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf2bcea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbf2415c330 con 0x7fbf240c64b0 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29285640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf240c64b0 0x7fbf240c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29a86640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf24155e20 0x7fbf2415bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56414/0 (socket says 172.21.15.12:56414) 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29a86640 1 -- 172.21.15.12:0/2260938967 learned_addr learned my addr 172.21.15.12:0/2260938967 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29285640 1 -- 172.21.15.12:0/2260938967 >> v1:172.21.15.100:6789/0 conn(0x7fbf240c6900 legacy=0x7fbf240cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29285640 1 -- 172.21.15.12:0/2260938967 >> v1:172.21.15.12:6789/0 conn(0x7fbf24155e20 legacy=0x7fbf2415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf29285640 1 -- 172.21.15.12:0/2260938967 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf2415c610 con 0x7fbf240c64b0 2024-04-26T17:58:17.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.648+0000 7fbf28a84640 1 -- 172.21.15.12:0/2260938967 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079305968 0 0) 0x7fbf24156200 con 0x7fbf24155e20 2024-04-26T17:58:17.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf29285640 1 --2- 172.21.15.12:0/2260938967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c64b0 0x7fbf240c77f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097a0 tx=0x7fbf1402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78c145dbcecc6a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf28a84640 1 -- 172.21.15.12:0/2260938967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14037070 con 0x7fbf240c64b0 2024-04-26T17:58:17.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf28a84640 1 -- 172.21.15.12:0/2260938967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf14032640 con 0x7fbf240c64b0 2024-04-26T17:58:17.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf28a84640 1 -- 172.21.15.12:0/2260938967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14032a10 con 0x7fbf240c64b0 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2260938967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c64b0 msgr2=0x7fbf240c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.649+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2260938967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c64b0 0x7fbf240c77f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbf140097a0 tx=0x7fbf1402a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.650+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2260938967 shutdown_connections 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.650+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2260938967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c64b0 0x7fbf240c77f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.650+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2260938967 >> 172.21.15.12:0/2260938967 conn(0x7fbf24072930 msgr2=0x7fbf24072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.650+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2260938967 shutdown_connections 2024-04-26T17:58:17.651 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.650+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2260938967 wait complete. 2024-04-26T17:58:17.653 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 Processor -- start 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 -- start start 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 0x7fbf24153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 0x7fbf24147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbf240c72d0 con 0x7fbf240c6900 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbf240c6ff0 con 0x7fbf240c64b0 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.651+0000 7fbf2bcea640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbf240cc8d0 con 0x7fbf24155e20 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34104/0 (socket says 172.21.15.12:34104) 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 -- 172.21.15.12:0/2816815765 learned_addr learned my addr 172.21.15.12:0/2816815765 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29a86640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 0x7fbf24153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 -- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 msgr2=0x7fbf24147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf2a287640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 0x7fbf24147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 0x7fbf24147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 -- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 msgr2=0x7fbf24153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 0x7fbf24153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 -- 172.21.15.12:0/2816815765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf241f27a0 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29a86640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 0x7fbf24153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf2a287640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 0x7fbf24147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf29285640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf14035040 tx=0x7fbf140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14041030 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf14030750 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf241f2a80 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf14037040 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.652+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf240d08b0 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.653+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf24076d20 con 0x7fbf240c6900 2024-04-26T17:58:17.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.654+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf14044070 con 0x7fbf240c6900 2024-04-26T17:58:17.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.654+0000 7fbf1a7fc640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 0x7fbf0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:17.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.654+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fbf140ac700 con 0x7fbf240c6900 2024-04-26T17:58:17.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.654+0000 7fbf29a86640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 0x7fbf0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:17.656 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.655+0000 7fbf29a86640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 0x7fbf0806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000f60 tx=0x7fbf20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:17.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.658+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbf1407a810 con 0x7fbf240c6900 2024-04-26T17:58:17.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:17.888+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fbf24159530 con 0x7fbf240c6900 2024-04-26T17:58:18.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.516+0000 7fbf1a7fc640 1 -- 172.21.15.12:0/2816815765 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fbf1407a110 con 0x7fbf240c6900 2024-04-26T17:58:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:added data pool 4 to fsmap 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 msgr2=0x7fbf0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 0x7fbf0806edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbf20000f60 tx=0x7fbf20009040 comp rx=0 tx=0).stop 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 msgr2=0x7fbf2414e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbf14035040 tx=0x7fbf140046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 shutdown_connections 2024-04-26T17:58:18.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbf0806c8f0 0x7fbf0806edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbf24155e20 0x7fbf24147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf240c6900 0x7fbf2414e840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 --2- 172.21.15.12:0/2816815765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf240c64b0 0x7fbf24153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 >> 172.21.15.12:0/2816815765 conn(0x7fbf24072930 msgr2=0x7fbf24150ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 shutdown_connections 2024-04-26T17:58:18.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.519+0000 7fbf2bcea640 1 -- 172.21.15.12:0/2816815765 wait complete. 2024-04-26T17:58:18.532 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:18.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.639+0000 7f2fad8c4640 1 Processor -- start 2024-04-26T17:58:18.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.639+0000 7f2fad8c4640 1 -- start start 2024-04-26T17:58:18.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fad8c4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2fa8153c50 0x7f2fa80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fad8c4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa8159d70 con 0x7f2fa80cfe90 2024-04-26T17:58:18.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fad8c4640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fa8154030 con 0x7f2fa80caab0 2024-04-26T17:58:18.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fad8c4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2fa80c43a0 con 0x7f2fa8153c50 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa6ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2fa8153c50 0x7f2fa80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2fa80cfe90 0x7f2fa81642d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56426/0 (socket says 172.21.15.12:56426) 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa77fe640 1 -- 172.21.15.12:0/1170248728 learned_addr learned my addr 172.21.15.12:0/1170248728 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa6ffd640 1 -- 172.21.15.12:0/1170248728 >> v1:172.21.15.100:6789/0 conn(0x7f2fa80caab0 legacy=0x7f2fa806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa6ffd640 1 -- 172.21.15.12:0/1170248728 >> v1:172.21.15.12:6789/0 conn(0x7f2fa80cfe90 legacy=0x7f2fa81642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.640+0000 7f2fa6ffd640 1 -- 172.21.15.12:0/1170248728 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa815a030 con 0x7f2fa8153c50 2024-04-26T17:58:18.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.641+0000 7f2fa6ffd640 1 --2- 172.21.15.12:0/1170248728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa80cf950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00097a0 tx=0x7f2fa002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6142a7e539579f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.641+0000 7f2fa5ffb640 1 -- 172.21.15.12:0/1170248728 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0037070 con 0x7f2fa8153c50 2024-04-26T17:58:18.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.641+0000 7f2fa5ffb640 1 -- 172.21.15.12:0/1170248728 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa0032440 con 0x7f2fa8153c50 2024-04-26T17:58:18.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.641+0000 7f2fa5ffb640 1 -- 172.21.15.12:0/1170248728 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0032810 con 0x7f2fa8153c50 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1170248728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 msgr2=0x7f2fa80cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1170248728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa80cf950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00097a0 tx=0x7f2fa002a270 comp rx=0 tx=0).stop 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1170248728 shutdown_connections 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1170248728 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa80cf950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1170248728 >> 172.21.15.12:0/1170248728 conn(0x7f2fa8071bf0 msgr2=0x7f2fa8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1170248728 shutdown_connections 2024-04-26T17:58:18.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.642+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1170248728 wait complete. 2024-04-26T17:58:18.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.643+0000 7f2fad8c4640 1 Processor -- start 2024-04-26T17:58:18.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.643+0000 7f2fad8c4640 1 -- start start 2024-04-26T17:58:18.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa80caab0 0x7f2fa8152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2fa80cfe90 0x7f2fa81f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa80cf4c0 con 0x7f2fa8153c50 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa815a8d0 con 0x7f2fa80caab0 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2fa815a5f0 con 0x7f2fa80cfe90 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34116/0 (socket says 172.21.15.12:34116) 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 -- 172.21.15.12:0/1840628126 learned_addr learned my addr 172.21.15.12:0/1840628126 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:18.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa6ffd640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa80caab0 0x7f2fa8152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa67fc640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2fa80cfe90 0x7f2fa81f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 -- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2fa80cfe90 msgr2=0x7f2fa81f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2fa80cfe90 0x7f2fa81f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 -- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa80caab0 msgr2=0x7f2fa8152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa80caab0 0x7f2fa8152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 -- 172.21.15.12:0/1840628126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa80b12e0 con 0x7f2fa8153c50 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fa77fe640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800cbc0 tx=0x7f2f9800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98017070 con 0x7f2fa8153c50 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f9800ace0 con 0x7f2fa8153c50 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa806d9d0 con 0x7f2fa8153c50 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.644+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98012600 con 0x7f2fa8153c50 2024-04-26T17:58:18.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.645+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa806df90 con 0x7f2fa8153c50 2024-04-26T17:58:18.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.646+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa8069ae0 con 0x7f2fa8153c50 2024-04-26T17:58:18.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.646+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f9801a070 con 0x7f2fa8153c50 2024-04-26T17:58:18.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.646+0000 7f2f8ffff640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 0x7f2f9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.646+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2f9808b9d0 con 0x7f2fa8153c50 2024-04-26T17:58:18.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.646+0000 7f2fa6ffd640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 0x7f2f9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.647+0000 7f2fa6ffd640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 0x7f2f9406ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0034000 tx=0x7f2fa002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.650 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.651+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f98059500 con 0x7f2fa8153c50 2024-04-26T17:58:18.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.874+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fa8076d20 con 0x7f2fa8153c50 2024-04-26T17:58:18.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.875+0000 7f2f8ffff640 1 -- 172.21.15.12:0/1840628126 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7f2f9805d800 con 0x7f2fa8153c50 2024-04-26T17:58:18.875 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:18.875 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:17.890576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-26T17:58:18.876 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 5 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 msgr2=0x7f2f9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 0x7f2f9406ede0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0034000 tx=0x7f2fa002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 msgr2=0x7f2fa81f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800cbc0 tx=0x7f2f9800a430 comp rx=0 tx=0).stop 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 shutdown_connections 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fa8153c50 0x7f2fa81f50f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2f9406c920 0x7f2f9406ede0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2fa80cfe90 0x7f2fa81f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 --2- 172.21.15.12:0/1840628126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2fa80caab0 0x7f2fa8152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 >> 172.21.15.12:0/1840628126 conn(0x7f2fa8071bf0 msgr2=0x7f2fa8157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 shutdown_connections 2024-04-26T17:58:18.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.877+0000 7f2fad8c4640 1 -- 172.21.15.12:0/1840628126 wait complete. 2024-04-26T17:58:18.888 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 Processor -- start 2024-04-26T17:58:18.988 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 -- start start 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1db4156060 0x7f1db40cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db415c790 0x7f1db40ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1db40cc8d0 con 0x7f1db40cea70 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1db40c68e0 con 0x7f1db4156060 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.988+0000 7f1db9ad9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1db4156440 con 0x7f1db415c790 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1db4156060 0x7f1db40cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1db4156060 0x7f1db40cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34128/0 (socket says 172.21.15.12:34128) 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 -- 172.21.15.12:0/970142877 learned_addr learned my addr 172.21.15.12:0/970142877 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db2ffd640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db415c790 0x7f1db40ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 -- 172.21.15.12:0/970142877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db415c790 msgr2=0x7f1db40ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db415c790 0x7f1db40ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 -- 172.21.15.12:0/970142877 >> v1:172.21.15.100:6789/0 conn(0x7f1db40cea70 legacy=0x7f1db40d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.989+0000 7f1db37fe640 1 -- 172.21.15.12:0/970142877 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40c6320 con 0x7f1db4156060 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db37fe640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db4156060 0x7f1db40cc2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009870 tx=0x7f1da402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6985836bd54d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db27fc640 1 -- 172.21.15.12:0/970142877 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4037070 con 0x7f1db4156060 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db27fc640 1 -- 172.21.15.12:0/970142877 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4032440 con 0x7f1db4156060 2024-04-26T17:58:18.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db27fc640 1 -- 172.21.15.12:0/970142877 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4032810 con 0x7f1db4156060 2024-04-26T17:58:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 -- 172.21.15.12:0/970142877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db4156060 msgr2=0x7f1db40cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db4156060 0x7f1db40cc2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009870 tx=0x7f1da402a1c0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 -- 172.21.15.12:0/970142877 shutdown_connections 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db415c790 0x7f1db40ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/970142877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db4156060 0x7f1db40cc2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 -- 172.21.15.12:0/970142877 >> 172.21.15.12:0/970142877 conn(0x7f1db4068090 msgr2=0x7f1db40684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 -- 172.21.15.12:0/970142877 shutdown_connections 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.990+0000 7f1db9ad9640 1 -- 172.21.15.12:0/970142877 wait complete. 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.991+0000 7f1db9ad9640 1 Processor -- start 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 -- start start 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db4156060 0x7f1db40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 0x7f1db415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.994 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40ce010 con 0x7f1db40cea70 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40cdd30 con 0x7f1db415c790 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db9ad9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1db40c6d20 con 0x7f1db4156060 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db37fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34138/0 (socket says 172.21.15.12:34138) 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.992+0000 7f1db37fe640 1 -- 172.21.15.12:0/2744012644 learned_addr learned my addr 172.21.15.12:0/2744012644 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db2ffd640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db4156060 0x7f1db40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db3fff640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 0x7f1db415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 -- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db4156060 msgr2=0x7f1db40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db4156060 0x7f1db40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 -- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 msgr2=0x7f1db415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 0x7f1db415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 -- 172.21.15.12:0/2744012644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40cfe90 con 0x7f1db40cea70 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db3fff640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 0x7f1db415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db37fe640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1da402a200 tx=0x7f1da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4041020 con 0x7f1db40cea70 2024-04-26T17:58:18.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da40306c0 con 0x7f1db40cea70 2024-04-26T17:58:18.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db41526a0 con 0x7f1db40cea70 2024-04-26T17:58:18.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4037040 con 0x7f1db40cea70 2024-04-26T17:58:18.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.993+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db41f1b40 con 0x7f1db40cea70 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.994+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db4076d20 con 0x7f1db40cea70 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.995+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1da4044020 con 0x7f1db40cea70 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.995+0000 7f1d9bfff640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 0x7f1da006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.995+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1da40ac660 con 0x7f1db40cea70 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.995+0000 7f1db2ffd640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 0x7f1da006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:18.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.996+0000 7f1db2ffd640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 0x7f1da006ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1db40c7870 tx=0x7f1da8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:18.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:18.999+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1da404b030 con 0x7f1db40cea70 2024-04-26T17:58:19.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.186+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1db40ccea0 con 0x7f1db40cea70 2024-04-26T17:58:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.187+0000 7f1d9bfff640 1 -- 172.21.15.12:0/2744012644 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f1da40a9860 con 0x7f1db40cea70 2024-04-26T17:58:19.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:19.188 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.189+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 msgr2=0x7f1da006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.189+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 0x7f1da006ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1db40c7870 tx=0x7f1da8008040 comp rx=0 tx=0).stop 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 msgr2=0x7f1db41f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1da402a200 tx=0x7f1da40046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 shutdown_connections 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1db415c790 0x7f1db415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1da006c920 0x7f1da006ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1db4156060 0x7f1db40cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 --2- 172.21.15.12:0/2744012644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1db40cea70 0x7f1db41f5770 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 >> 172.21.15.12:0/2744012644 conn(0x7f1db4068090 msgr2=0x7f1db40d1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 shutdown_connections 2024-04-26T17:58:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.190+0000 7f1db9ad9640 1 -- 172.21.15.12:0/2744012644 wait complete. 2024-04-26T17:58:19.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:19.301 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.301+0000 7fbffacf8640 1 Processor -- start 2024-04-26T17:58:19.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.301+0000 7fbffacf8640 1 -- start start 2024-04-26T17:58:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbffacf8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbffacf8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40cd840 0x7fbff40c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbffacf8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff415f2a0 con 0x7fbff4156180 2024-04-26T17:58:19.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbffacf8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbff415cbc0 con 0x7fbff40cd840 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbffacf8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbff40cc730 con 0x7fbff4155da0 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40cd840 0x7fbff40c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbff40cd840 0x7fbff40c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34144/0 (socket says 172.21.15.12:34144) 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 -- 172.21.15.12:0/3314242724 learned_addr learned my addr 172.21.15.12:0/3314242724 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff8a94640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 -- 172.21.15.12:0/3314242724 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 msgr2=0x7fbff415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 -- 172.21.15.12:0/3314242724 >> v1:172.21.15.100:6789/0 conn(0x7fbff4156180 legacy=0x7fbff40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff9295640 1 -- 172.21.15.12:0/3314242724 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff415f580 con 0x7fbff40cd840 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.302+0000 7fbff8a94640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.303+0000 7fbff9295640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff40c62a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009870 tx=0x7fbfe402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9375da0beedf340 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.303+0000 7fbff37fe640 1 -- 172.21.15.12:0/3314242724 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4037070 con 0x7fbff40cd840 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.303+0000 7fbff37fe640 1 -- 172.21.15.12:0/3314242724 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe4032440 con 0x7fbff40cd840 2024-04-26T17:58:19.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.303+0000 7fbff37fe640 1 -- 172.21.15.12:0/3314242724 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4032810 con 0x7fbff40cd840 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 -- 172.21.15.12:0/3314242724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 msgr2=0x7fbff40c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff40c62a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009870 tx=0x7fbfe402a180 comp rx=0 tx=0).stop 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 -- 172.21.15.12:0/3314242724 shutdown_connections 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff40c62a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 --2- 172.21.15.12:0/3314242724 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 -- 172.21.15.12:0/3314242724 >> 172.21.15.12:0/3314242724 conn(0x7fbff4068090 msgr2=0x7fbff40684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 -- 172.21.15.12:0/3314242724 shutdown_connections 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.304+0000 7fbffacf8640 1 -- 172.21.15.12:0/3314242724 wait complete. 2024-04-26T17:58:19.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.305+0000 7fbffacf8640 1 Processor -- start 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.305+0000 7fbffacf8640 1 -- start start 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbff415cd60 0x7fbff4147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbff40d19d0 con 0x7fbff40cd840 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbff415fb40 con 0x7fbff415cd60 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbffacf8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbff40d1b50 con 0x7fbff4155da0 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34148/0 (socket says 172.21.15.12:34148) 2024-04-26T17:58:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 -- 172.21.15.12:0/1646975324 learned_addr learned my addr 172.21.15.12:0/1646975324 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff9295640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbff415cd60 0x7fbff4147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff3fff640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 -- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 msgr2=0x7fbff415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 -- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbff415cd60 msgr2=0x7fbff4147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbff415cd60 0x7fbff4147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 -- 172.21.15.12:0/1646975324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff41f1a90 con 0x7fbff40cd840 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff8a94640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00cf60 tx=0x7fbfec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.306+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec01a070 con 0x7fbff40cd840 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.307+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfec00d840 con 0x7fbff40cd840 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.307+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff415d310 con 0x7fbff40cd840 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.307+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00dc10 con 0x7fbff40cd840 2024-04-26T17:58:19.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.307+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff41f1d30 con 0x7fbff40cd840 2024-04-26T17:58:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.308+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff4076d20 con 0x7fbff40cd840 2024-04-26T17:58:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.308+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbfec01d070 con 0x7fbff40cd840 2024-04-26T17:58:19.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.308+0000 7fbff17fa640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 0x7fbfe006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.309+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbfec08c6f0 con 0x7fbff40cd840 2024-04-26T17:58:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.309+0000 7fbff3fff640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 0x7fbfe006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.309+0000 7fbff3fff640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 0x7fbfe006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbff40b7710 tx=0x7fbfe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.313+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbfec05a100 con 0x7fbff40cd840 2024-04-26T17:58:19.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.499+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbff40cecd0 con 0x7fbff40cd840 2024-04-26T17:58:19.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.500+0000 7fbff17fa640 1 -- 172.21.15.12:0/1646975324 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fbfec05e400 con 0x7fbff40cd840 2024-04-26T17:58:19.500 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:19.500 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 msgr2=0x7fbfe006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 0x7fbfe006ede0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbff40b7710 tx=0x7fbfe8008040 comp rx=0 tx=0).stop 2024-04-26T17:58:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 msgr2=0x7fbff41f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00cf60 tx=0x7fbfec00cf90 comp rx=0 tx=0).stop 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 shutdown_connections 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbff415cd60 0x7fbff4147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbfe006c920 0x7fbfe006ede0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbff4155da0 0x7fbff415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 --2- 172.21.15.12:0/1646975324 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbff40cd840 0x7fbff41f2530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 >> 172.21.15.12:0/1646975324 conn(0x7fbff4068090 msgr2=0x7fbff41543b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 shutdown_connections 2024-04-26T17:58:19.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.502+0000 7fbffacf8640 1 -- 172.21.15.12:0/1646975324 wait complete. 2024-04-26T17:58:19.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:19.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.629+0000 7ff67f111640 1 Processor -- start 2024-04-26T17:58:19.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.629+0000 7ff67f111640 1 -- start start 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67f111640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff678153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67f111640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780708a0 con 0x7ff6780c44e0 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67f111640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6780ca650 con 0x7ff6780c48c0 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67f111640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff6780ca930 con 0x7ff678071490 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67cead640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff6780c44e0 0x7ff6780cb4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56440/0 (socket says 172.21.15.12:56440) 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.630+0000 7ff67cead640 1 -- 172.21.15.12:0/518595929 learned_addr learned my addr 172.21.15.12:0/518595929 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:19.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67d6ae640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff678153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727891649 0 0) 0x7ff6780708a0 con 0x7ff6780c44e0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff660003520 con 0x7ff6780c44e0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262998598 0 0) 0x7ff6780ca650 con 0x7ff6780c48c0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6780708a0 con 0x7ff6780c48c0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 177488708 0 0) 0x7ff660003520 con 0x7ff6780c44e0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 msgr2=0x7ff678153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff678153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 >> v1:172.21.15.100:6789/0 conn(0x7ff6780c48c0 legacy=0x7ff678070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6780cac10 con 0x7ff6780c44e0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7ff6700019f0 con 0x7ff6780c44e0 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 >> v1:172.21.15.12:6789/0 conn(0x7ff6780c44e0 legacy=0x7ff6780cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff660003b70 0x7ff660003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff660004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff660004d40 0x7ff6600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780ca930 con 0x7ff660003b70 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff66000ba70 con 0x7ff660004d40 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff66000bc70 con 0x7ff678071490 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff660003b70 0x7ff660003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff677fff640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff660004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67d6ae640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff660004d40 0x7ff6600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 -- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 msgr2=0x7ff660004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff678071490 0x7ff660004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 -- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff660004d40 msgr2=0x7ff6600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff660004d40 0x7ff6600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.631+0000 7ff67cead640 1 -- 172.21.15.12:0/518595929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff660003520 con 0x7ff660003b70 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.632+0000 7ff67cead640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff660003b70 0x7ff660003f70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff67000a800 tx=0x7ff660005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfdd856fd1779b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.632+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67000a450 con 0x7ff660003b70 2024-04-26T17:58:19.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.632+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff67002f070 con 0x7ff660003b70 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.632+0000 7ff6777fe640 1 -- 172.21.15.12:0/518595929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff67002bc70 con 0x7ff660003b70 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 -- 172.21.15.12:0/518595929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff660003b70 msgr2=0x7ff660003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 --2- 172.21.15.12:0/518595929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff660003b70 0x7ff660003f70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff67000a800 tx=0x7ff660005830 comp rx=0 tx=0).stop 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67d6ae640 1 -- 172.21.15.12:0/518595929 reap_dead start 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 -- 172.21.15.12:0/518595929 shutdown_connections 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 -- 172.21.15.12:0/518595929 >> 172.21.15.12:0/518595929 conn(0x7ff678076760 msgr2=0x7ff678068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 -- 172.21.15.12:0/518595929 shutdown_connections 2024-04-26T17:58:19.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.633+0000 7ff67f111640 1 -- 172.21.15.12:0/518595929 wait complete. 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.634+0000 7ff67f111640 1 Processor -- start 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.634+0000 7ff67f111640 1 -- start start 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff660003b70 0x7ff6780c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 0x7ff678147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780c63e0 con 0x7ff6780c74c0 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff6780cb1d0 con 0x7ff678147940 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67f111640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff6780c9c50 con 0x7ff660003b70 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34176/0 (socket says 172.21.15.12:34176) 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 -- 172.21.15.12:0/3363148037 learned_addr learned my addr 172.21.15.12:0/3363148037 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:19.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67cead640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff660003b70 0x7ff6780c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67d6ae640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 0x7ff678147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 -- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff660003b70 msgr2=0x7ff6780c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff660003b70 0x7ff6780c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 -- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 msgr2=0x7ff678147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 0x7ff678147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 -- 172.21.15.12:0/3363148037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff678148c30 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff67d6ae640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 0x7ff678147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.635+0000 7ff677fff640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00f7a0 tx=0x7ff66c00fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.636+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00fe50 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.636+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff66c018070 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.636+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67814d8a0 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.636+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66c00d730 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.636+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff678148300 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.637+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff678069ae0 con 0x7ff6780c74c0 2024-04-26T17:58:19.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.637+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff66c00d8d0 con 0x7ff6780c74c0 2024-04-26T17:58:19.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.637+0000 7ff6757fa640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.638+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff66c08bcf0 con 0x7ff6780c74c0 2024-04-26T17:58:19.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.638+0000 7ff67cead640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.638+0000 7ff67cead640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 0x7ff66406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff670033000 tx=0x7ff670007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.642+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff66c090070 con 0x7ff6780c74c0 2024-04-26T17:58:19.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.864+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff678152fb0 con 0x7ff6780c74c0 2024-04-26T17:58:19.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.865+0000 7ff6757fa640 1 -- 172.21.15.12:0/3363148037 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6831 (secure 0 0 0) 0x7ff678152fb0 con 0x7ff6780c74c0 2024-04-26T17:58:19.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:19.865 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:19.484271+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:19.866 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 6 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.866+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 msgr2=0x7ff66406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.866+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 0x7ff66406edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff670033000 tx=0x7ff670007000 comp rx=0 tx=0).stop 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.866+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 msgr2=0x7ff6780c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.866+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00f7a0 tx=0x7ff66c00fc60 comp rx=0 tx=0).stop 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 shutdown_connections 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff678147940 0x7ff678147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6780c74c0 0x7ff6780c7900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff66406c8f0 0x7ff66406edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 --2- 172.21.15.12:0/3363148037 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff660003b70 0x7ff6780c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 >> 172.21.15.12:0/3363148037 conn(0x7ff678076760 msgr2=0x7ff678153430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 shutdown_connections 2024-04-26T17:58:19.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.867+0000 7ff67f111640 1 -- 172.21.15.12:0/3363148037 wait complete. 2024-04-26T17:58:19.878 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:19.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.977+0000 7fc9835e2640 1 Processor -- start 2024-04-26T17:58:19.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.977+0000 7fc9835e2640 1 -- start start 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc9835e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97c0cd840 0x7fc97c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc9835e2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97c15f2a0 con 0x7fc97c156180 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc9835e2640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc97c15f580 con 0x7fc97c155da0 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc9835e2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc97c15cbc0 con 0x7fc97c0cd840 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc981b7f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97c0cd840 0x7fc97c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc981b7f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc97c0cd840 0x7fc97c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34182/0 (socket says 172.21.15.12:34182) 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc980b7d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc97c156180 0x7fc97c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56446/0 (socket says 172.21.15.12:56446) 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.978+0000 7fc981b7f640 1 -- 172.21.15.12:0/2391669994 learned_addr learned my addr 172.21.15.12:0/2391669994 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc981b7f640 1 -- 172.21.15.12:0/2391669994 >> v1:172.21.15.100:6789/0 conn(0x7fc97c155da0 legacy=0x7fc97c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:19.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc981b7f640 1 -- 172.21.15.12:0/2391669994 >> v1:172.21.15.12:6789/0 conn(0x7fc97c156180 legacy=0x7fc97c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc981b7f640 1 -- 172.21.15.12:0/2391669994 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c15f860 con 0x7fc97c0cd840 2024-04-26T17:58:19.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc97bfff640 1 -- 172.21.15.12:0/2391669994 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5144488 0 0) 0x7fc97c15f2a0 con 0x7fc97c156180 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc981b7f640 1 --2- 172.21.15.12:0/2391669994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0cd840 0x7fc97c15c680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009e50 tx=0x7fc96c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2eaf47b3309057 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc97bfff640 1 -- 172.21.15.12:0/2391669994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c036070 con 0x7fc97c0cd840 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.979+0000 7fc97bfff640 1 -- 172.21.15.12:0/2391669994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc96c031600 con 0x7fc97c0cd840 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc97bfff640 1 -- 172.21.15.12:0/2391669994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0319d0 con 0x7fc97c0cd840 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 -- 172.21.15.12:0/2391669994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0cd840 msgr2=0x7fc97c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2391669994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0cd840 0x7fc97c15c680 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009e50 tx=0x7fc96c02a730 comp rx=0 tx=0).stop 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 -- 172.21.15.12:0/2391669994 shutdown_connections 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2391669994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c0cd840 0x7fc97c15c680 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 -- 172.21.15.12:0/2391669994 >> 172.21.15.12:0/2391669994 conn(0x7fc97c068090 msgr2=0x7fc97c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 -- 172.21.15.12:0/2391669994 shutdown_connections 2024-04-26T17:58:19.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.980+0000 7fc9835e2640 1 -- 172.21.15.12:0/2391669994 wait complete. 2024-04-26T17:58:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.981+0000 7fc9835e2640 1 Processor -- start 2024-04-26T17:58:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.981+0000 7fc9835e2640 1 -- start start 2024-04-26T17:58:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc97c0cd840 0x7fc97c1f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97c1f2240 0x7fc97c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c0d19d0 con 0x7fc97c155da0 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c0cc730 con 0x7fc97c1f2240 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc9835e2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc97c0d1b50 con 0x7fc97c0cd840 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34198/0 (socket says 172.21.15.12:34198) 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 -- 172.21.15.12:0/2386554268 learned_addr learned my addr 172.21.15.12:0/2386554268 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc98137e640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc97c0cd840 0x7fc97c1f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc981b7f640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97c1f2240 0x7fc97c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 -- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc97c0cd840 msgr2=0x7fc97c1f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc97c0cd840 0x7fc97c1f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 -- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97c1f2240 msgr2=0x7fc97c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97c1f2240 0x7fc97c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:19.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.982+0000 7fc980b7d640 1 -- 172.21.15.12:0/2386554268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c15ce00 con 0x7fc97c155da0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc980b7d640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c460 tx=0x7fc97000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970018070 con 0x7fc97c155da0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc970007520 con 0x7fc97c155da0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c15d0a0 con 0x7fc97c155da0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970004a20 con 0x7fc97c155da0 2024-04-26T17:58:19.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.983+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1f5850 con 0x7fc97c155da0 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.984+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c076d20 con 0x7fc97c155da0 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.984+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc97001b070 con 0x7fc97c155da0 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.985+0000 7fc979ffb640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 0x7fc96806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.985+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc97008b250 con 0x7fc97c155da0 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.985+0000 7fc98137e640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 0x7fc96806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:19.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.986+0000 7fc98137e640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 0x7fc96806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc974000f60 tx=0x7fc974009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:19.989 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:19.989+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc970059340 con 0x7fc97c155da0 2024-04-26T17:58:20.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.175+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc97c0cd330 con 0x7fc97c155da0 2024-04-26T17:58:20.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.176+0000 7fc979ffb640 1 -- 172.21.15.12:0/2386554268 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fc970058c40 con 0x7fc97c155da0 2024-04-26T17:58:20.177 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:20.177 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:20.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 msgr2=0x7fc96806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 0x7fc96806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc974000f60 tx=0x7fc974009040 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 msgr2=0x7fc97c153600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc97000c460 tx=0x7fc97000c920 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 shutdown_connections 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc97c1f2240 0x7fc97c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc97c155da0 0x7fc97c153600 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc96806c8f0 0x7fc96806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 --2- 172.21.15.12:0/2386554268 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc97c0cd840 0x7fc97c1f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 >> 172.21.15.12:0/2386554268 conn(0x7fc97c068090 msgr2=0x7fc97c159e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 shutdown_connections 2024-04-26T17:58:20.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.178+0000 7fc9835e2640 1 -- 172.21.15.12:0/2386554268 wait complete. 2024-04-26T17:58:20.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:12.845520+0000', 'modified': '2024-04-26T17:58:19.484271+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3743641599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3743641599}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3743641599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-04-26T17:58:20.793 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:20.793 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T17:58:20.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.902+0000 7f59c467b640 1 Processor -- start 2024-04-26T17:58:20.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.902+0000 7f59c467b640 1 -- start start 2024-04-26T17:58:20.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c467b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59bc155e50 0x7f59bc0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c467b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 0x7f59bc0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c467b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59bc15ba80 con 0x7f59bc0c9f60 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c467b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f59bc15c630 con 0x7f59bc155e50 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c467b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc156230 con 0x7f59bc072910 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c2c18640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f59bc0c9f60 0x7f59bc0cdb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56448/0 (socket says 172.21.15.12:56448) 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.903+0000 7f59c2c18640 1 -- 172.21.15.12:0/2367055762 learned_addr learned my addr 172.21.15.12:0/2367055762 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c2417640 1 --2- 172.21.15.12:0/2367055762 >> v2:172.21.15.100:3300/0 conn(0x7f59bc155e50 0x7f59bc0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c1c16640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 0x7f59bc0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c1415640 1 -- 172.21.15.12:0/2367055762 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559745389 0 0) 0x7f59b4001490 con 0x7f59bc0c9f60 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c1415640 1 -- 172.21.15.12:0/2367055762 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003520 con 0x7f59bc0c9f60 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c2417640 1 -- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 msgr2=0x7f59bc0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c2417640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 0x7f59bc0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c2417640 1 -- 172.21.15.12:0/2367055762 >> v1:172.21.15.12:6789/0 conn(0x7f59bc0c9f60 legacy=0x7f59bc0cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c2417640 1 -- 172.21.15.12:0/2367055762 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc073f30 con 0x7f59bc155e50 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.904+0000 7f59c1c16640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 0x7f59bc0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.905+0000 7f59c2417640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc0c8620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097a0 tx=0x7f59b802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a538004f6a745d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.905+0000 7f59c1415640 1 -- 172.21.15.12:0/2367055762 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8037070 con 0x7f59bc155e50 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.905+0000 7f59c1415640 1 -- 172.21.15.12:0/2367055762 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b8032440 con 0x7f59bc155e50 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.905+0000 7f59c1415640 1 -- 172.21.15.12:0/2367055762 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80327f0 con 0x7f59bc155e50 2024-04-26T17:58:20.910 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 -- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 msgr2=0x7f59bc0c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc0c8620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f59b80097a0 tx=0x7f59b802a210 comp rx=0 tx=0).stop 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 -- 172.21.15.12:0/2367055762 shutdown_connections 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc072910 0x7f59bc0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 --2- 172.21.15.12:0/2367055762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc0c8620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 -- 172.21.15.12:0/2367055762 >> 172.21.15.12:0/2367055762 conn(0x7f59bc06e500 msgr2=0x7f59bc06e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 -- 172.21.15.12:0/2367055762 shutdown_connections 2024-04-26T17:58:20.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.906+0000 7f59c467b640 1 -- 172.21.15.12:0/2367055762 wait complete. 2024-04-26T17:58:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.907+0000 7f59c467b640 1 Processor -- start 2024-04-26T17:58:20.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.907+0000 7f59c467b640 1 -- start start 2024-04-26T17:58:20.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc0c9f60 0x7f59bc14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc070460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc15bfe0 con 0x7f59bc072910 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc15bd00 con 0x7f59bc155e50 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc15c2c0 con 0x7f59bc0c9f60 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34208/0 (socket says 172.21.15.12:34208) 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 -- 172.21.15.12:0/1985764606 learned_addr learned my addr 172.21.15.12:0/1985764606 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c1c16640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc0c9f60 0x7f59bc14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2c18640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 -- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc0c9f60 msgr2=0x7f59bc14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc0c9f60 0x7f59bc14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 -- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 msgr2=0x7f59bc070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 -- 172.21.15.12:0/1985764606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc15ce20 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c2417640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59b802a250 tx=0x7f59b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59b2ffd640 1 -- 172.21.15.12:0/1985764606 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8041070 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59b2ffd640 1 -- 172.21.15.12:0/1985764606 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b803c870 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc1f5520 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.908+0000 7f59b2ffd640 1 -- 172.21.15.12:0/1985764606 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8037040 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.909+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc1f5ae0 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.910+0000 7f59b2ffd640 1 -- 172.21.15.12:0/1985764606 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59b8044070 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.911+0000 7f59b2ffd640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 0x7f59a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.911+0000 7f59b2ffd640 1 -- 172.21.15.12:0/1985764606 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f59b80ac820 con 0x7f59bc072910 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.911+0000 7f59c1c16640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 0x7f59a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.911+0000 7f59c1c16640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 0x7f59a006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009a30 tx=0x7f59ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.912+0000 7f59c7393740 1 Processor -- start 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.912+0000 7f59c7393740 1 -- start start 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.912+0000 7f59c7393740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.912+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada20b20 0x55fbada22a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada22f70 0x55fbada4e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c7393740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbad989740 con 0x55fbada4df90 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fbad9253a0 con 0x55fbada20b20 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55fbad985700 con 0x55fbada22f70 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34224/0 (socket says 172.21.15.12:34224) 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 -- 172.21.15.12:0/3879231141 learned_addr learned my addr 172.21.15.12:0/3879231141 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c1c16640 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada20b20 0x55fbada22a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2c18640 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada22f70 0x55fbada4e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 -- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada22f70 msgr2=0x55fbada4e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada22f70 0x55fbada4e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 -- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada20b20 msgr2=0x55fbada22a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada20b20 0x55fbada22a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 -- 172.21.15.12:0/3879231141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbad941750 con 0x55fbada4df90 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f59c2417640 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59b8006ce0 tx=0x7f59b807a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fabe80e1f72ef05 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f599ffff640 1 -- 172.21.15.12:0/3879231141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b804b040 con 0x55fbada4df90 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f599ffff640 1 -- 172.21.15.12:0/3879231141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b807e770 con 0x55fbada4df90 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.913+0000 7f599ffff640 1 -- 172.21.15.12:0/3879231141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8082fa0 con 0x55fbada4df90 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 -- 172.21.15.12:0/3879231141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 msgr2=0x55fbada69830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f59b8006ce0 tx=0x7f59b807a030 comp rx=0 tx=0).stop 2024-04-26T17:58:20.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 -- 172.21.15.12:0/3879231141 shutdown_connections 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada22f70 0x55fbada4e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada20b20 0x55fbada22a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 --2- 172.21.15.12:0/3879231141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada69830 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 -- 172.21.15.12:0/3879231141 >> 172.21.15.12:0/3879231141 conn(0x55fbada219b0 msgr2=0x55fbada68e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 -- 172.21.15.12:0/3879231141 shutdown_connections 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.914+0000 7f59c7393740 1 -- 172.21.15.12:0/3879231141 wait complete. 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.915+0000 7f59c7393740 1 -- start start 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.915+0000 7f59c7393740 1 Processor -- start 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 0x55fbada1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbad989740 con 0x55fbada76170 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fbad910fe0 con 0x55fbada4b530 2024-04-26T17:58:20.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55fbada20fb0 con 0x55fbada4df90 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 10 client.0 _ll_register_callbacks cb 0x55fbad927150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34236/0 (socket says 172.21.15.12:34236) 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 -- 172.21.15.12:0/2452190288 learned_addr learned my addr 172.21.15.12:0/2452190288 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c2417640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 0x55fbada1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c2c18640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 -- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 msgr2=0x55fbada1ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 0x55fbada1ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 -- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 msgr2=0x55fbada4b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:20.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 -- 172.21.15.12:0/2452190288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbad69b2d0 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c2417640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 0x55fbada1ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c1c16640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59ac015750 tx=0x7f59ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f521b40b1ae379c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f599d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac014660 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f59ac014800 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.916+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59b807e770 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f59ac032050 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 10 client.4413 fetch_fsmap learned FSMap version 6 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fbad7656b0 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b807e770 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f59ac035020 con 0x55fbada76170 2024-04-26T17:58:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 10 client.4413 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 20 client.4413 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada827f0 0x55fbada84be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 4 client.4413 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbad997350 con 0x55fbada827f0 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.917+0000 7f59c2417640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada827f0 0x55fbada84be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.918+0000 7f59c2417640 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada827f0 0x55fbada84be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0b40f20d7cd570c server_cookie=d98bc9c46aab4ff0 in_seq=0 out_seq=0 2024-04-26T17:58:20.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:20.918+0000 7f599d7fa640 10 client.4413 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:24.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.486+0000 7f599d7fa640 1 -- 172.21.15.12:0/2452190288 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fbad997350 con 0x55fbada827f0 2024-04-26T17:58:24.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.486+0000 7f599d7fa640 10 client.4413 handle_command_reply: tid=0 2024-04-26T17:58:24.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.486+0000 7f59c7393740 1 client.4413 shutdown 2024-04-26T17:58:24.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.486+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 msgr2=0x55fbada674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.486+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f59ac015750 tx=0x7f59ac0046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 shutdown_connections 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada827f0 0x55fbada84be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada76170 0x55fbada674a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 --2- 172.21.15.12:0/2452190288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4df90 0x55fbada1ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f599d7fa640 0 client.4413 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 >> 172.21.15.12:0/2452190288 conn(0x55fbada22f70 msgr2=0x55fbada24d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 shutdown_connections 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 1 -- 172.21.15.12:0/2452190288 wait complete. 2024-04-26T17:58:24.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.487+0000 7f59c7393740 20 client.4413 trim_cache size 0 max 16384 2024-04-26T17:58:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.506+0000 7f59c7393740 1 Processor -- start 2024-04-26T17:58:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 -- start start 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4b530 0x55fbada4e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 0x55fbada23590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc14bff0 con 0x55fbada4df90 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc1fe490 con 0x55fbada76170 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55fbada67020 con 0x55fbada4b530 2024-04-26T17:58:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56244/0 (socket says 172.21.15.12:56244) 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.507+0000 7f59c1c16640 1 -- 172.21.15.12:0/721796702 learned_addr learned my addr 172.21.15.12:0/721796702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c2c18640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 0x55fbada23590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c2417640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4b530 0x55fbada4e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 -- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4b530 msgr2=0x55fbada4e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4b530 0x55fbada4e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 -- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 msgr2=0x55fbada23590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 0x55fbada23590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 -- 172.21.15.12:0/721796702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbada76bc0 con 0x55fbada4df90 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c2c18640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 0x55fbada23590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f59c1c16640 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59ac014ba0 tx=0x7f59ac023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ba39d1ab6eb525 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f599f7fe640 1 -- 172.21.15.12:0/721796702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac014e40 con 0x55fbada4df90 2024-04-26T17:58:24.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f599f7fe640 1 -- 172.21.15.12:0/721796702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac03a070 con 0x55fbada4df90 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.508+0000 7f599f7fe640 1 -- 172.21.15.12:0/721796702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac014660 con 0x55fbada4df90 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 -- 172.21.15.12:0/721796702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 msgr2=0x55fbada4e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f59ac014ba0 tx=0x7f59ac023000 comp rx=0 tx=0).stop 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 -- 172.21.15.12:0/721796702 shutdown_connections 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada76170 0x55fbada23590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4e8b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 --2- 172.21.15.12:0/721796702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada4b530 0x55fbada4e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 -- 172.21.15.12:0/721796702 >> 172.21.15.12:0/721796702 conn(0x55fbada22f70 msgr2=0x55fbada67f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 -- 172.21.15.12:0/721796702 shutdown_connections 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.509+0000 7f59c7393740 1 -- 172.21.15.12:0/721796702 wait complete. 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.510+0000 7f59c7393740 1 -- start start 2024-04-26T17:58:24.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.510+0000 7f59c7393740 1 Processor -- start 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada76170 0x55fbadad9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55fbada69ba0 con 0x55fbada4df90 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55fbada76550 con 0x55fbada4b530 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55fbada79490 con 0x55fbada76170 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c7393740 10 client.0 _ll_register_callbacks cb 0x7f59ac0119a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c1c16640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56246/0 (socket says 172.21.15.12:56246) 2024-04-26T17:58:24.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c1c16640 1 -- 172.21.15.12:0/3808722218 learned_addr learned my addr 172.21.15.12:0/3808722218 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c2417640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c2c18640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada76170 0x55fbadad9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.511+0000 7f59c1c16640 1 -- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada76170 msgr2=0x55fbadad9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c1c16640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada76170 0x55fbadad9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c1c16640 1 -- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 msgr2=0x55fbada4e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c1c16640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c1c16640 1 -- 172.21.15.12:0/3808722218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbada20240 con 0x55fbada4df90 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c1c16640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59ac014d20 tx=0x7f59ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b5f482e4b8c03f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f599d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac048430 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f59ac00f040 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59ac03a070 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f59ac005990 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c7393740 10 client.4419 fetch_fsmap learned FSMap version 6 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55fbada8a830 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.512+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac03a070 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f59ac047070 con 0x55fbada4df90 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 10 client.4419 fetch_fsmap finished waiting for FSMap version 6 2024-04-26T17:58:24.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 20 client.4419 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada89410 0x55fbadaec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 4 client.4419 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "status"}) -- 0x55fbad9911c0 con 0x55fbada89410 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c2417640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada89410 0x55fbadaec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c2417640 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada89410 0x55fbadaec9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40a4796ad9ade130 server_cookie=867cf0c0cf526ea3 in_seq=0 out_seq=0 2024-04-26T17:58:24.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f599d7fa640 10 client.4419 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f599d7fa640 1 -- 172.21.15.12:0/3808722218 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55fbad9911c0 con 0x55fbada89410 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f599d7fa640 10 client.4419 handle_command_reply: tid=0 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.513+0000 7f59c7393740 1 client.4419 shutdown 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 msgr2=0x55fbada4ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59ac014d20 tx=0x7f59ac016000 comp rx=0 tx=0).stop 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 shutdown_connections 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fbada76170 0x55fbadad9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55fbada4df90 0x55fbada4ce90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55fbada89410 0x55fbadaec9f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 --2- 172.21.15.12:0/3808722218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fbada4b530 0x55fbada4e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 >> 172.21.15.12:0/3808722218 conn(0x55fbada22f70 msgr2=0x55fbada65ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f599d7fa640 0 client.4419 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 shutdown_connections 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 1 -- 172.21.15.12:0/3808722218 wait complete. 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.514+0000 7f59c7393740 20 client.4419 trim_cache size 0 max 16384 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "68faa4ec-4899-41e7-bbbd-182baff15e13", 2024-04-26T17:58:24.522 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4300, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.03576754, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 6, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.068944459000001 2024-04-26T17:58:24.523 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:58:24.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 msgr2=0x7f59a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 0x7f59a006edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f59ac009a30 tx=0x7f59ac008040 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 msgr2=0x7f59bc0c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59b802a250 tx=0x7f59b80046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 shutdown_connections 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59bc155e50 0x7f59bc070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f59a006c8f0 0x7f59a006edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f59bc0c9f60 0x7f59bc14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 --2- 172.21.15.12:0/1985764606 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc072910 0x7f59bc0c6d80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 >> 172.21.15.12:0/1985764606 conn(0x7f59bc06e500 msgr2=0x7f59bc0c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 shutdown_connections 2024-04-26T17:58:24.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.515+0000 7f59c467b640 1 -- 172.21.15.12:0/1985764606 wait complete. 2024-04-26T17:58:24.528 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T17:58:24.528 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:24.529 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T17:58:24.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.636+0000 7f5509fe9640 1 Processor -- start 2024-04-26T17:58:24.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.636+0000 7f5509fe9640 1 -- start start 2024-04-26T17:58:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5509fe9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5504155c90 0x7f55040735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5509fe9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f55040d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5509fe9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55040c6330 con 0x7f55040d1cc0 2024-04-26T17:58:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5509fe9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f5504156070 con 0x7f5504155c90 2024-04-26T17:58:24.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5509fe9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f55040c6610 con 0x7f550415c5b0 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5504155c90 0x7f55040735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5503fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55040d1cc0 0x7f550415d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47206/0 (socket says 172.21.15.12:47206) 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5504155c90 0x7f55040735c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56248/0 (socket says 172.21.15.12:56248) 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5503fff640 1 -- 172.21.15.12:0/3637307470 learned_addr learned my addr 172.21.15.12:0/3637307470 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5502ffd640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f55040d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 -- 172.21.15.12:0/3637307470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 msgr2=0x7f55040d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f55040d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 -- 172.21.15.12:0/3637307470 >> v1:172.21.15.12:6789/0 conn(0x7f55040d1cc0 legacy=0x7f550415d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55037fe640 1 -- 172.21.15.12:0/3637307470 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55040c68f0 con 0x7f5504155c90 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f55027fc640 1 -- 172.21.15.12:0/3637307470 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433933959 0 0) 0x7f55040c6330 con 0x7f55040d1cc0 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.637+0000 7f5502ffd640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f55040d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:24.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.638+0000 7f55037fe640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f55040735c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95af1211db0a381 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.638+0000 7f55027fc640 1 -- 172.21.15.12:0/3637307470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4037070 con 0x7f5504155c90 2024-04-26T17:58:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.638+0000 7f55027fc640 1 -- 172.21.15.12:0/3637307470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f4032440 con 0x7f5504155c90 2024-04-26T17:58:24.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.638+0000 7f55027fc640 1 -- 172.21.15.12:0/3637307470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4032810 con 0x7f5504155c90 2024-04-26T17:58:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 -- 172.21.15.12:0/3637307470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 msgr2=0x7f55040735c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f55040735c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54f40097a0 tx=0x7f54f402a210 comp rx=0 tx=0).stop 2024-04-26T17:58:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 -- 172.21.15.12:0/3637307470 shutdown_connections 2024-04-26T17:58:24.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f55040d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3637307470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f55040735c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 -- 172.21.15.12:0/3637307470 >> 172.21.15.12:0/3637307470 conn(0x7f5504074030 msgr2=0x7f5504074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 -- 172.21.15.12:0/3637307470 shutdown_connections 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.639+0000 7f5509fe9640 1 -- 172.21.15.12:0/3637307470 wait complete. 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.640+0000 7f5509fe9640 1 Processor -- start 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.640+0000 7f5509fe9640 1 -- start start 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040d1cc0 0x7f55040ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f550414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f55040c7190 con 0x7f5504155c90 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f55040c6eb0 con 0x7f55040d1cc0 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f550415c9f0 con 0x7f550415c5b0 2024-04-26T17:58:24.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56250/0 (socket says 172.21.15.12:56250) 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 -- 172.21.15.12:0/3226624043 learned_addr learned my addr 172.21.15.12:0/3226624043 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 -- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 msgr2=0x7f550414c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f550414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 -- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040d1cc0 msgr2=0x7f55040ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040d1cc0 0x7f55040ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 -- 172.21.15.12:0/3226624043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55041f22d0 con 0x7f5504155c90 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5502ffd640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54f800d7d0 tx=0x7f54f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8004030 con 0x7f5504155c90 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f80041d0 con 0x7f5504155c90 2024-04-26T17:58:24.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55040c8820 con 0x7f5504155c90 2024-04-26T17:58:24.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f80096a0 con 0x7f5504155c90 2024-04-26T17:58:24.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.641+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55040ca1e0 con 0x7f5504155c90 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.643+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5504076d20 con 0x7f5504155c90 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.643+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f54f8009840 con 0x7f5504155c90 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.643+0000 7f54ebfff640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 0x7f54f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.643+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f54f808c1f0 con 0x7f5504155c90 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.643+0000 7f55037fe640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 0x7f54f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:24.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.644+0000 7f55037fe640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 0x7f54f006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:24.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.648+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f54f805a250 con 0x7f5504155c90 2024-04-26T17:58:24.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.874+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5504159dd0 con 0x7f5504155c90 2024-04-26T17:58:24.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.874+0000 7f54ebfff640 1 -- 172.21.15.12:0/3226624043 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f54f8059b50 con 0x7f5504155c90 2024-04-26T17:58:24.875 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T17:58:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 msgr2=0x7f54f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 0x7f54f006ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54f4034000 tx=0x7f54f402c000 comp rx=0 tx=0).stop 2024-04-26T17:58:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 msgr2=0x7f550414bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f54f800d7d0 tx=0x7f54f800dc90 comp rx=0 tx=0).stop 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 shutdown_connections 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f54f006c920 0x7f54f006ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f550415c5b0 0x7f550414c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5504155c90 0x7f550414bce0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 --2- 172.21.15.12:0/3226624043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040d1cc0 0x7f55040ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 >> 172.21.15.12:0/3226624043 conn(0x7f5504074030 msgr2=0x7f550415d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 shutdown_connections 2024-04-26T17:58:24.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24.877+0000 7f5509fe9640 1 -- 172.21.15.12:0/3226624043 wait complete. 2024-04-26T17:58:24.888 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-26T17:58:24.888 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T17:58:24.888 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-04-26T17:58:24.888 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-26T17:58:24.889 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:24.889 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-26T17:58:24.889 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T17:58:24.889 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T17:58:24.889 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T17:58:24.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:24.889 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-04-26T17:58:24.905 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-04-26T17:58:24.906 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42696sec preferred_lft 42696sec 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:24.907 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-04-26T17:58:24.908 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T17:58:24.908 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:25.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:25.087 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T17:58:25.112 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-04-26T17:58:25.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:25.114 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-04-26T17:58:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-04-26T17:58:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T17:58:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T17:58:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T17:58:25.175 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T17:58:25.176 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:25.264 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:25.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:25.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:25.455 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-04-26T17:58:25.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:25.470 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-04-26T17:58:25.525 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:25.525 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:25.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:25.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-26T17:58:25.525 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:25.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:25.645 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-26T17:58:25.646 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:25.773 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:25.773 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:25.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-04-26T17:58:25.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T17:58:25.773 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:25.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:25.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:25.851 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-26T17:58:25.851 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:25.851 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:25.866 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-26T17:58:25.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:25.866 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:25.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-04-26T17:58:25.987 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-04-26T17:58:26.043 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-04-26T17:58:26.044 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T17:58:26.045 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T17:58:26.046 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-04-26T17:58:26.046 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:26.046 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:26.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:26.046 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-04-26T17:58:26.098 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-26T17:58:26.098 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-26T17:58:26.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-04-26T17:58:26.165 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-04-26T17:58:26.221 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T17:58:26.222 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:26.223 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:26.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:26.224 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-04-26T17:58:26.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:2024-04-26T17:58:26.248+0000 7f20ebe5b480 -1 init, newargv = 0x55ee645072b0 newargc=15 2024-04-26T17:58:26.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[41925]: starting ceph client 2024-04-26T17:58:26.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[41925]: starting fuse 2024-04-26T17:58:27.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo modprobe fuse 2024-04-26T17:58:27.395 DEBUG:teuthology.orchestra.run.smithi012:> cat /proc/self/mounts | awk '{print $2}' 2024-04-26T17:58:27.455 INFO:teuthology.orchestra.run.smithi012.stdout:/proc 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/dev 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/security 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/shm 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/pts 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/run 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/cgroup 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/pstore 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/bpf 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/ 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/selinux 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/proc/sys/fs/binfmt_misc 2024-04-26T17:58:27.456 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/hugepages 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/dev/mqueue 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/debug 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/tracing 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysusers.service 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/kernel/config 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/sys/fs/fuse/connections 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-sysctl.service 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/nfs/rpc_pipefs 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/run/user/1000 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-0 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-1 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-2 2024-04-26T17:58:27.457 INFO:teuthology.orchestra.run.smithi012.stdout:/var/lib/ceph/osd/ceph-3 2024-04-26T17:58:27.458 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns 2024-04-26T17:58:27.458 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:27.458 INFO:teuthology.orchestra.run.smithi012.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:27.458 INFO:teuthology.orchestra.run.smithi012.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:27.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:27.459 DEBUG:teuthology.orchestra.run.smithi012:> ls /sys/fs/fuse/connections 2024-04-26T17:58:27.517 INFO:teuthology.orchestra.run.smithi012.stdout:43 2024-04-26T17:58:27.517 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-26T17:58:27.517 DEBUG:teuthology.orchestra.run.smithi012:> sudo stdin-killer -- python3 -c ' 2024-04-26T17:58:27.517 DEBUG:teuthology.orchestra.run.smithi012:> import glob 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> import re 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> import os 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> import subprocess 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> def _find_admin_socket(client_name): 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> files = glob.glob(asok_path) 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> # Given a non-glob path, it better be there 2024-04-26T17:58:27.518 DEBUG:teuthology.orchestra.run.smithi012:> if "*" not in asok_path: 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> assert(len(files) == 1) 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> return files[0] 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> for f in files: 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> contents = proc_f.read() 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> if mountpoint in contents: 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> return f 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-26T17:58:27.519 DEBUG:teuthology.orchestra.run.smithi012:> 2024-04-26T17:58:27.520 DEBUG:teuthology.orchestra.run.smithi012:> print(_find_admin_socket("client.admin")) 2024-04-26T17:58:27.520 DEBUG:teuthology.orchestra.run.smithi012:> ' 2024-04-26T17:58:27.646 INFO:teuthology.orchestra.run.smithi012.stdout:/var/run/ceph/ceph-client.admin.41925.asok 2024-04-26T17:58:27.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:27.657 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41925.asok 2024-04-26T17:58:27.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:27.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41925.asok status 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "metadata": { 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_sha1": "bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1", 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "ceph_version": "ceph version 19.0.0-3267-gbc94a2a9 (bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1) squid (dev)", 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "entity_id": "admin", 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "hostname": "smithi012", 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-26T17:58:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: "pid": "41925", 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "root": "/" 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_count": 0, 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "dentry_pinned_count": 0, 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4437, 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "inst": { 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "name": { 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "client", 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "num": 4437 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-04-26T17:58:27.797 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 675511985 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": { 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "type": "v1", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "addr": "192.168.0.1:0", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "nonce": 675511985 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "inst_str": "client.4437 192.168.0.1:0/675511985", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "addr_str": "192.168.0.1:0/675511985", 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "inode_count": 1, 2024-04-26T17:58:27.798 INFO:teuthology.orchestra.run.smithi012.stdout: "mds_epoch": 6, 2024-04-26T17:58:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch": 24, 2024-04-26T17:58:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "osd_epoch_barrier": 0, 2024-04-26T17:58:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "blocklisted": false, 2024-04-26T17:58:27.799 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs" 2024-04-26T17:58:27.799 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:58:27.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:27.804 DEBUG:teuthology.orchestra.run.smithi012:> stat --file-system '--printf=%T 2024-04-26T17:58:27.804 DEBUG:teuthology.orchestra.run.smithi012:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:27.820 INFO:teuthology.orchestra.run.smithi012.stdout:fuseblk 2024-04-26T17:58:27.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:27.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:27.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:27.885 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-26T17:58:27.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:28.308 INFO:teuthology.orchestra.run.smithi012.stdout:# file: . 2024-04-26T17:58:28.308 INFO:teuthology.orchestra.run.smithi012.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-26T17:58:28.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:28.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:28.315 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:58:28.315 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:28.331 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T17:58:28.452 INFO:tasks.ceph.mds.b.smithi100.stderr:2024-04-26T17:58:28.453+0000 7f38fac3b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-26T17:58:28.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.473+0000 7f00d0aea640 1 Processor -- start 2024-04-26T17:58:28.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.473+0000 7f00d0aea640 1 -- start start 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00d0aea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00cc155e50 0x7f00cc15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00d0aea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc15f200 con 0x7f00cc0d1320 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00d0aea640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00cc0cc6e0 con 0x7f00cc0cd610 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00d0aea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f00cc0c6980 con 0x7f00cc155e50 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00ca59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00cc155e50 0x7f00cc15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00cad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f00cc0d1320 0x7f00cc166590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47212/0 (socket says 172.21.15.12:47212) 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00cad9d640 1 -- 172.21.15.12:0/788858670 learned_addr learned my addr 172.21.15.12:0/788858670 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00ca59c640 1 -- 172.21.15.12:0/788858670 >> v1:172.21.15.100:6789/0 conn(0x7f00cc0cd610 legacy=0x7f00cc0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00ca59c640 1 -- 172.21.15.12:0/788858670 >> v1:172.21.15.12:6789/0 conn(0x7f00cc0d1320 legacy=0x7f00cc166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00c959a640 1 -- 172.21.15.12:0/788858670 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002650817 0 0) 0x7f00cc15f200 con 0x7f00cc0d1320 2024-04-26T17:58:28.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00ca59c640 1 -- 172.21.15.12:0/788858670 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc0cc9c0 con 0x7f00cc155e50 2024-04-26T17:58:28.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00ca59c640 1 --2- 172.21.15.12:0/788858670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc155e50 0x7f00cc15c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d095686cc26e51 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00c959a640 1 -- 172.21.15.12:0/788858670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4037070 con 0x7f00cc155e50 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00c959a640 1 -- 172.21.15.12:0/788858670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c4032440 con 0x7f00cc155e50 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.475+0000 7f00c959a640 1 -- 172.21.15.12:0/788858670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4032810 con 0x7f00cc155e50 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 -- 172.21.15.12:0/788858670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc155e50 msgr2=0x7f00cc15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 --2- 172.21.15.12:0/788858670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc155e50 0x7f00cc15c690 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f00c40097a0 tx=0x7f00c402a270 comp rx=0 tx=0).stop 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 -- 172.21.15.12:0/788858670 shutdown_connections 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 --2- 172.21.15.12:0/788858670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc155e50 0x7f00cc15c690 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 -- 172.21.15.12:0/788858670 >> 172.21.15.12:0/788858670 conn(0x7f00cc0762e0 msgr2=0x7f00cc073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 -- 172.21.15.12:0/788858670 shutdown_connections 2024-04-26T17:58:28.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.476+0000 7f00d0aea640 1 -- 172.21.15.12:0/788858670 wait complete. 2024-04-26T17:58:28.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 Processor -- start 2024-04-26T17:58:28.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 -- start start 2024-04-26T17:58:28.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00cc0cd610 0x7f00cc1e5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00cc155e50 0x7f00cc1f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc15fa60 con 0x7f00cc0d1320 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f00cc15f780 con 0x7f00cc0cd610 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00d0aea640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f00cc156230 con 0x7f00cc155e50 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56266/0 (socket says 172.21.15.12:56266) 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 -- 172.21.15.12:0/1575541721 learned_addr learned my addr 172.21.15.12:0/1575541721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00ca59c640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00cc0cd610 0x7f00cc1e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00cad9d640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00cc155e50 0x7f00cc1f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 -- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00cc155e50 msgr2=0x7f00cc1f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00cc155e50 0x7f00cc1f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 -- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00cc0cd610 msgr2=0x7f00cc1e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00cc0cd610 0x7f00cc1e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.478+0000 7f00c9d9b640 1 -- 172.21.15.12:0/1575541721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00cc0caf00 con 0x7f00cc0d1320 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00c9d9b640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00b400c400 tx=0x7f00b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4017070 con 0x7f00cc0d1320 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b4003640 con 0x7f00cc0d1320 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00cc1e7b30 con 0x7f00cc0d1320 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4003a30 con 0x7f00cc0d1320 2024-04-26T17:58:28.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.479+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00cc1e8c90 con 0x7f00cc0d1320 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.480+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00cc076d20 con 0x7f00cc0d1320 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.480+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00b4003bd0 con 0x7f00cc0d1320 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.481+0000 7f00c2ffd640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 0x7f00ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.481+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f00b408b190 con 0x7f00cc0d1320 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.481+0000 7f00ca59c640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 0x7f00ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.482+0000 7f00ca59c640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 0x7f00ac06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00c4034000 tx=0x7f00c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.485+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00b4058bb0 con 0x7f00cc0d1320 2024-04-26T17:58:28.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.688+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f00cc0cf340 con 0x7f00cc0d1320 2024-04-26T17:58:28.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.689+0000 7f00c2ffd640 1 -- 172.21.15.12:0/1575541721 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f00b405ceb0 con 0x7f00cc0d1320 2024-04-26T17:58:28.689 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-04-26T17:58:28.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 msgr2=0x7f00ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 0x7f00ac06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00c4034000 tx=0x7f00c402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 msgr2=0x7f00cc1e5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00b400c400 tx=0x7f00b400c8c0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 shutdown_connections 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f00ac06c8f0 0x7f00ac06edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00cc155e50 0x7f00cc1f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00cc0d1320 0x7f00cc1e5ab0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 --2- 172.21.15.12:0/1575541721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00cc0cd610 0x7f00cc1e5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 >> 172.21.15.12:0/1575541721 conn(0x7f00cc0762e0 msgr2=0x7f00cc153620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 shutdown_connections 2024-04-26T17:58:28.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.691+0000 7f00d0aea640 1 -- 172.21.15.12:0/1575541721 wait complete. 2024-04-26T17:58:28.702 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:58:28.702 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:28.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T17:58:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.859+0000 7f989d587640 1 Processor -- start 2024-04-26T17:58:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.859+0000 7f989d587640 1 -- start start 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f989d587640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9898155e50 0x7f989815c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f989d587640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98980d1320 0x7f98980d1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f989d587640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f989815f200 con 0x7f98980cd610 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f989d587640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f98980c6980 con 0x7f98980d1320 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f989d587640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f98980cc6e0 con 0x7f9898155e50 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98980d1320 0x7f98980d1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98980d1320 0x7f98980d1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56270/0 (socket says 172.21.15.12:56270) 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 -- 172.21.15.12:0/482586898 learned_addr learned my addr 172.21.15.12:0/482586898 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f9896ffd640 1 --2- 172.21.15.12:0/482586898 >> v2:172.21.15.100:3300/0 conn(0x7f9898155e50 0x7f989815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 -- 172.21.15.12:0/482586898 >> v2:172.21.15.100:3300/0 conn(0x7f9898155e50 msgr2=0x7f989815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 --2- 172.21.15.12:0/482586898 >> v2:172.21.15.100:3300/0 conn(0x7f9898155e50 0x7f989815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 -- 172.21.15.12:0/482586898 >> v1:172.21.15.100:6789/0 conn(0x7f98980cd610 legacy=0x7f98980c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.860+0000 7f98977fe640 1 -- 172.21.15.12:0/482586898 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98980cc9c0 con 0x7f98980d1320 2024-04-26T17:58:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.861+0000 7f98977fe640 1 --2- 172.21.15.12:0/482586898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980d1320 0x7f98980d1770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98980cef10 tx=0x7f989002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca9a9ec7b017fb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.861+0000 7f98967fc640 1 -- 172.21.15.12:0/482586898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9890036070 con 0x7f98980d1320 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.861+0000 7f98967fc640 1 -- 172.21.15.12:0/482586898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9890031600 con 0x7f98980d1320 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.861+0000 7f98967fc640 1 -- 172.21.15.12:0/482586898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98900319f0 con 0x7f98980d1320 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 -- 172.21.15.12:0/482586898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980d1320 msgr2=0x7f98980d1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 --2- 172.21.15.12:0/482586898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980d1320 0x7f98980d1770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f98980cef10 tx=0x7f989002a7c0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 -- 172.21.15.12:0/482586898 shutdown_connections 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 --2- 172.21.15.12:0/482586898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980d1320 0x7f98980d1770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 --2- 172.21.15.12:0/482586898 >> v2:172.21.15.100:3300/0 conn(0x7f9898155e50 0x7f989815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 -- 172.21.15.12:0/482586898 >> 172.21.15.12:0/482586898 conn(0x7f98980762e0 msgr2=0x7f9898073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 -- 172.21.15.12:0/482586898 shutdown_connections 2024-04-26T17:58:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.862+0000 7f989d587640 1 -- 172.21.15.12:0/482586898 wait complete. 2024-04-26T17:58:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.863+0000 7f989d587640 1 Processor -- start 2024-04-26T17:58:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.863+0000 7f989d587640 1 -- start start 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 0x7f98981f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9898155e50 0x7f9898156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f989815fa60 con 0x7f98980cd610 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f989815f780 con 0x7f98980d1320 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9898156230 con 0x7f9898155e50 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56274/0 (socket says 172.21.15.12:56274) 2024-04-26T17:58:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 -- 172.21.15.12:0/1610491921 learned_addr learned my addr 172.21.15.12:0/1610491921 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f988ffff640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 0x7f98981f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 -- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9898155e50 msgr2=0x7f9898156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f98977fe640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9898155e50 0x7f9898156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9898155e50 0x7f9898156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 -- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 msgr2=0x7f98981f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 0x7f98981f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 -- 172.21.15.12:0/1610491921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f989815b730 con 0x7f98980cd610 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f988ffff640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 0x7f98981f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f9896ffd640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f988800d5d0 tx=0x7f988800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880125f0 con 0x7f98980cd610 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9888019070 con 0x7f98980cd610 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f989815ba10 con 0x7f98980cd610 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.864+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98880129f0 con 0x7f98980cd610 2024-04-26T17:58:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.865+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9898151fa0 con 0x7f98980cd610 2024-04-26T17:58:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.866+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98981521a0 con 0x7f98980cd610 2024-04-26T17:58:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.866+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9888012b90 con 0x7f98980cd610 2024-04-26T17:58:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.866+0000 7f988f7fe640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 0x7f987806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.866+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f988808c1c0 con 0x7f98980cd610 2024-04-26T17:58:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.867+0000 7f988ffff640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 0x7f987806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.867+0000 7f988ffff640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 0x7f987806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f989815efb0 tx=0x7f9880009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:28.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:28.871+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f98981521a0 con 0x7f98980cd610 2024-04-26T17:58:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.068+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9898076d20 con 0x7f98980cd610 2024-04-26T17:58:29.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.068+0000 7f988f7fe640 1 -- 172.21.15.12:0/1610491921 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f988805a2a0 con 0x7f98980cd610 2024-04-26T17:58:29.069 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 msgr2=0x7f987806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 0x7f987806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f989815efb0 tx=0x7f9880009040 comp rx=0 tx=0).stop 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 msgr2=0x7f98981524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f988800d5d0 tx=0x7f988800da90 comp rx=0 tx=0).stop 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 shutdown_connections 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f987806c920 0x7f987806ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9898155e50 0x7f9898156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98980d1320 0x7f98981f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 --2- 172.21.15.12:0/1610491921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98980cd610 0x7f98981524c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:29.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 >> 172.21.15.12:0/1610491921 conn(0x7f98980762e0 msgr2=0x7f98980d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:29.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 shutdown_connections 2024-04-26T17:58:29.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:29.070+0000 7f989d587640 1 -- 172.21.15.12:0/1610491921 wait complete. 2024-04-26T17:58:29.081 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi012.front.sepia.ceph.com... 2024-04-26T17:58:29.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:29.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-26T17:58:29.104 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi012.stderr:ceph-fuse[41925]: fuse finished with error 0 and tester_r 0 2024-04-26T17:58:29.107 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T17:58:35.209 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T17:58:35.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:35.209 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-26T17:58:35.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.387+0000 7f2a63edc640 1 Processor -- start 2024-04-26T17:58:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 -- start start 2024-04-26T17:58:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a5c155d00 0x7f2a5c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a5c0ccd90 con 0x7f2a5c0702f0 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2a5c1560e0 con 0x7f2a5c155d00 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.388+0000 7f2a63edc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c15cb60 con 0x7f2a5c0cb680 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61477640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a5c155d00 0x7f2a5c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2a5c155d00 0x7f2a5c0c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:40212/0 (socket says 172.21.15.12:40212) 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61477640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36496/0 (socket says 172.21.15.12:36496) 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 -- 172.21.15.12:0/257015570 learned_addr learned my addr 172.21.15.12:0/257015570 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a62479640 1 --1- 172.21.15.12:0/257015570 >> v1:172.21.15.100:6789/0 conn(0x7f2a5c0702f0 0x7f2a5c15f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44794/0 (socket says 172.21.15.12:44794) 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a60c76640 1 -- 172.21.15.12:0/257015570 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310205491 0 0) 0x7f2a54001110 con 0x7f2a5c0702f0 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a60c76640 1 -- 172.21.15.12:0/257015570 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a44003520 con 0x7f2a5c0702f0 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 -- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 msgr2=0x7f2a5c06fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 -- 172.21.15.12:0/257015570 >> v1:172.21.15.100:6789/0 conn(0x7f2a5c0702f0 legacy=0x7f2a5c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61c78640 1 -- 172.21.15.12:0/257015570 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c15bfe0 con 0x7f2a5c155d00 2024-04-26T17:58:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.389+0000 7f2a61477640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.390+0000 7f2a61c78640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c155d00 0x7f2a5c0c9e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009e50 tx=0x7f2a4c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac8198482e887b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.390+0000 7f2a60c76640 1 -- 172.21.15.12:0/257015570 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c036070 con 0x7f2a5c155d00 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.390+0000 7f2a60c76640 1 -- 172.21.15.12:0/257015570 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c031600 con 0x7f2a5c155d00 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.390+0000 7f2a60c76640 1 -- 172.21.15.12:0/257015570 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0319b0 con 0x7f2a5c155d00 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 -- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c155d00 msgr2=0x7f2a5c0c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c155d00 0x7f2a5c0c9e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009e50 tx=0x7f2a4c02a710 comp rx=0 tx=0).stop 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 -- 172.21.15.12:0/257015570 shutdown_connections 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c0cb680 0x7f2a5c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 --2- 172.21.15.12:0/257015570 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c155d00 0x7f2a5c0c9e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 -- 172.21.15.12:0/257015570 >> 172.21.15.12:0/257015570 conn(0x7f2a5c071bf0 msgr2=0x7f2a5c071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 -- 172.21.15.12:0/257015570 shutdown_connections 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.391+0000 7f2a63edc640 1 -- 172.21.15.12:0/257015570 wait complete. 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.392+0000 7f2a63edc640 1 Processor -- start 2024-04-26T17:58:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.392+0000 7f2a63edc640 1 -- start start 2024-04-26T17:58:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c0cb680 0x7f2a5c1f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 0x7f2a5c1f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15c880 con 0x7f2a5c0702f0 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5c15c5a0 con 0x7f2a5c0cb680 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a63edc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2a5c15f2c0 con 0x7f2a5c155d00 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42848/0 (socket says 172.21.15.12:42848) 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 -- 172.21.15.12:0/3915689031 learned_addr learned my addr 172.21.15.12:0/3915689031 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61477640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c0cb680 0x7f2a5c1f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a62479640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 0x7f2a5c1f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 -- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 msgr2=0x7f2a5c1f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 0x7f2a5c1f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 -- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c0cb680 msgr2=0x7f2a5c1f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c0cb680 0x7f2a5c1f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 -- 172.21.15.12:0/3915689031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a5c1f3050 con 0x7f2a5c0702f0 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a62479640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 0x7f2a5c1f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.393+0000 7f2a61c78640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c02ad00 tx=0x7f2a4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.394+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c03f020 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.394+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a4c037040 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.394+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a5c0b0c90 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.394+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c036070 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.394+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a5c0afaf0 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.395+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5c069ae0 con 0x7f2a5c0702f0 2024-04-26T17:58:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.395+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a4c042020 con 0x7f2a5c0702f0 2024-04-26T17:58:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.396+0000 7f2a5a7fc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 0x7f2a4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.396+0000 7f2a61477640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 0x7f2a4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.396+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2a4c0ac2e0 con 0x7f2a5c0702f0 2024-04-26T17:58:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.396+0000 7f2a61477640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 0x7f2a4806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009560 tx=0x7f2a50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.400+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2a4c049030 con 0x7f2a5c0702f0 2024-04-26T17:58:35.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.587+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2a5c0af8e0 con 0x7f2a5c0702f0 2024-04-26T17:58:35.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.588+0000 7f2a5a7fc640 1 -- 172.21.15.12:0/3915689031 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f2a4c07a340 con 0x7f2a5c0702f0 2024-04-26T17:58:35.588 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:35.588 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:35.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 msgr2=0x7f2a4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 0x7f2a4806edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009560 tx=0x7f2a50008040 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 msgr2=0x7f2a5c0b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c02ad00 tx=0x7f2a4c004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 shutdown_connections 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2a4806c8f0 0x7f2a4806edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a5c155d00 0x7f2a5c1f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a5c0cb680 0x7f2a5c1f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 --2- 172.21.15.12:0/3915689031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a5c0702f0 0x7f2a5c0b1210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 >> 172.21.15.12:0/3915689031 conn(0x7f2a5c071bf0 msgr2=0x7f2a5c0ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 shutdown_connections 2024-04-26T17:58:35.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.590+0000 7f2a63edc640 1 -- 172.21.15.12:0/3915689031 wait complete. 2024-04-26T17:58:35.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:35.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.702+0000 7f2aee32b640 1 Processor -- start 2024-04-26T17:58:35.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.702+0000 7f2aee32b640 1 -- start start 2024-04-26T17:58:35.703 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aee32b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070020 0x7f2ae80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aee32b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ae8070400 0x7f2ae8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aee32b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae80c9e20 con 0x7f2ae80cb410 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aee32b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae815fba0 con 0x7f2ae8070400 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aee32b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae80cb200 con 0x7f2ae8070020 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2ae77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ae8070400 0x7f2ae8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aec8c8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2ae80cb410 0x7f2ae815c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60586/0 (socket says 172.21.15.12:60586) 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2ae77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ae8070400 0x7f2ae8155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42858/0 (socket says 172.21.15.12:42858) 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2aec8c8640 1 -- 172.21.15.12:0/2262637507 learned_addr learned my addr 172.21.15.12:0/2262637507 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.703+0000 7f2ae7fff640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070020 0x7f2ae80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae77fe640 1 -- 172.21.15.12:0/2262637507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070020 msgr2=0x7f2ae80cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae77fe640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070020 0x7f2ae80cacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae77fe640 1 -- 172.21.15.12:0/2262637507 >> v1:172.21.15.12:6789/0 conn(0x7f2ae80cb410 legacy=0x7f2ae815c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae77fe640 1 -- 172.21.15.12:0/2262637507 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae815fdd0 con 0x7f2ae8070400 2024-04-26T17:58:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae77fe640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8070400 0x7f2ae8155a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80097a0 tx=0x7f2ad802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a67f70475756399 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae6ffd640 1 -- 172.21.15.12:0/2262637507 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8037070 con 0x7f2ae8070400 2024-04-26T17:58:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae6ffd640 1 -- 172.21.15.12:0/2262637507 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad8032440 con 0x7f2ae8070400 2024-04-26T17:58:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.704+0000 7f2ae6ffd640 1 -- 172.21.15.12:0/2262637507 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8032810 con 0x7f2ae8070400 2024-04-26T17:58:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 -- 172.21.15.12:0/2262637507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8070400 msgr2=0x7f2ae8155a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8070400 0x7f2ae8155a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80097a0 tx=0x7f2ad802a180 comp rx=0 tx=0).stop 2024-04-26T17:58:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 -- 172.21.15.12:0/2262637507 shutdown_connections 2024-04-26T17:58:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae8070400 0x7f2ae8155a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 --2- 172.21.15.12:0/2262637507 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070020 0x7f2ae80cacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 -- 172.21.15.12:0/2262637507 >> 172.21.15.12:0/2262637507 conn(0x7f2ae8071bf0 msgr2=0x7f2ae8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 -- 172.21.15.12:0/2262637507 shutdown_connections 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.705+0000 7f2aee32b640 1 -- 172.21.15.12:0/2262637507 wait complete. 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.706+0000 7f2aee32b640 1 Processor -- start 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.706+0000 7f2aee32b640 1 -- start start 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae8070020 0x7f2ae80b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070400 0x7f2ae80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae8160070 con 0x7f2ae80cb410 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae80ca370 con 0x7f2ae8070020 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aee32b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae80cccb0 con 0x7f2ae8070400 2024-04-26T17:58:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aec8c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aec8c8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42868/0 (socket says 172.21.15.12:42868) 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2aec8c8640 1 -- 172.21.15.12:0/377190923 learned_addr learned my addr 172.21.15.12:0/377190923 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2ae77fe640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070400 0x7f2ae80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.707+0000 7f2ae7fff640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae8070020 0x7f2ae80b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 -- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070400 msgr2=0x7f2ae80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070400 0x7f2ae80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 -- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae8070020 msgr2=0x7f2ae80b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae8070020 0x7f2ae80b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 -- 172.21.15.12:0/377190923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae81f1720 con 0x7f2ae80cb410 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aec8c8640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000ca80 tx=0x7f2ae000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0017070 con 0x7f2ae80cb410 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae000ac30 con 0x7f2ae80cb410 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae81f1a00 con 0x7f2ae80cb410 2024-04-26T17:58:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0012600 con 0x7f2ae80cb410 2024-04-26T17:58:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.708+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae81f1fc0 con 0x7f2ae80cb410 2024-04-26T17:58:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.709+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae8069ae0 con 0x7f2ae80cb410 2024-04-26T17:58:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.709+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ae001a070 con 0x7f2ae80cb410 2024-04-26T17:58:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.710+0000 7f2ae4ff9640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 0x7f2ac806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.710+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ae008ba30 con 0x7f2ae80cb410 2024-04-26T17:58:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.710+0000 7f2ae7fff640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 0x7f2ac806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.711+0000 7f2ae7fff640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 0x7f2ac806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0006fd0 tx=0x7f2ad0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:35.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.714+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ae000ae20 con 0x7f2ae80cb410 2024-04-26T17:58:35.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.902+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ae8076d20 con 0x7f2ae80cb410 2024-04-26T17:58:35.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.903+0000 7f2ae4ff9640 1 -- 172.21.15.12:0/377190923 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f2ae0059560 con 0x7f2ae80cb410 2024-04-26T17:58:35.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:35.903 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 msgr2=0x7f2ac806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 0x7f2ac806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0006fd0 tx=0x7f2ad0008040 comp rx=0 tx=0).stop 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 msgr2=0x7f2ae80b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ae000ca80 tx=0x7f2ae000cf40 comp rx=0 tx=0).stop 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 shutdown_connections 2024-04-26T17:58:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ae80cb410 0x7f2ae80b2600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2ac806c8f0 0x7f2ac806edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2ae8070400 0x7f2ae80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 --2- 172.21.15.12:0/377190923 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae8070020 0x7f2ae80b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 >> 172.21.15.12:0/377190923 conn(0x7f2ae8071bf0 msgr2=0x7f2ae80afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 shutdown_connections 2024-04-26T17:58:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:35.906+0000 7f2aee32b640 1 -- 172.21.15.12:0/377190923 wait complete. 2024-04-26T17:58:35.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T17:58:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.022+0000 7fdbf6893640 1 Processor -- start 2024-04-26T17:58:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.022+0000 7fdbf6893640 1 -- start start 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf6893640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf0156010 0x7fdbf00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf6893640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf00ca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf6893640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbf00c4c00 con 0x7fdbf00caa60 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf6893640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdbf00c4ee0 con 0x7fdbf0156010 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf6893640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00c51c0 con 0x7fdbf00cfec0 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbeffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf0156010 0x7fdbf00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf4e30640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdbf00caa60 0x7fdbf006ccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60602/0 (socket says 172.21.15.12:60602) 2024-04-26T17:58:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.023+0000 7fdbf4e30640 1 -- 172.21.15.12:0/1497166663 learned_addr learned my addr 172.21.15.12:0/1497166663 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbef7fe640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf00ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeffff640 1 -- 172.21.15.12:0/1497166663 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 msgr2=0x7fdbf00ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeffff640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf00ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeffff640 1 -- 172.21.15.12:0/1497166663 >> v1:172.21.15.12:6789/0 conn(0x7fdbf00caa60 legacy=0x7fdbf006ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeffff640 1 -- 172.21.15.12:0/1497166663 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf00c54a0 con 0x7fdbf0156010 2024-04-26T17:58:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeeffd640 1 -- 172.21.15.12:0/1497166663 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2038892358 0 0) 0x7fdbf00c4c00 con 0x7fdbf00caa60 2024-04-26T17:58:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.024+0000 7fdbeffff640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf0156010 0x7fdbf00c58d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097a0 tx=0x7fdbe002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b95f24ed45c8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbeeffd640 1 -- 172.21.15.12:0/1497166663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0037070 con 0x7fdbf0156010 2024-04-26T17:58:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbeeffd640 1 -- 172.21.15.12:0/1497166663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe0032440 con 0x7fdbf0156010 2024-04-26T17:58:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbeeffd640 1 -- 172.21.15.12:0/1497166663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0032810 con 0x7fdbf0156010 2024-04-26T17:58:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 -- 172.21.15.12:0/1497166663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf0156010 msgr2=0x7fdbf00c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf0156010 0x7fdbf00c58d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00097a0 tx=0x7fdbe002a180 comp rx=0 tx=0).stop 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 -- 172.21.15.12:0/1497166663 shutdown_connections 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf00ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 --2- 172.21.15.12:0/1497166663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf0156010 0x7fdbf00c58d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 -- 172.21.15.12:0/1497166663 >> 172.21.15.12:0/1497166663 conn(0x7fdbf006fe70 msgr2=0x7fdbf0070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 -- 172.21.15.12:0/1497166663 shutdown_connections 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.025+0000 7fdbf6893640 1 -- 172.21.15.12:0/1497166663 wait complete. 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.026+0000 7fdbf6893640 1 Processor -- start 2024-04-26T17:58:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.026+0000 7fdbf6893640 1 -- start start 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf01f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0156010 0x7fdbf01f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00c5f90 con 0x7fdbf00caa60 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf00c5e10 con 0x7fdbf0156010 2024-04-26T17:58:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbf6893640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf00cf3b0 con 0x7fdbf00cfec0 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42876/0 (socket says 172.21.15.12:42876) 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 -- 172.21.15.12:0/4241988520 learned_addr learned my addr 172.21.15.12:0/4241988520 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 -- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 msgr2=0x7fdbf01f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf01f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 -- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0156010 msgr2=0x7fdbf01f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.027+0000 7fdbeffff640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0156010 0x7fdbf01f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbeffff640 1 -- 172.21.15.12:0/4241988520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf00b4d80 con 0x7fdbf00caa60 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbeffff640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098c0 tx=0x7fdbe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0037040 con 0x7fdbf00caa60 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe0030500 con 0x7fdbf00caa60 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbf00b4ff0 con 0x7fdbf00caa60 2024-04-26T17:58:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00308d0 con 0x7fdbf00caa60 2024-04-26T17:58:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.028+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbf00b2e90 con 0x7fdbf00caa60 2024-04-26T17:58:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.029+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbf0069ae0 con 0x7fdbf00caa60 2024-04-26T17:58:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.029+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdbe0044020 con 0x7fdbf00caa60 2024-04-26T17:58:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.030+0000 7fdbecff9640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 0x7fdbdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.030+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbe00ac1e0 con 0x7fdbf00caa60 2024-04-26T17:58:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.030+0000 7fdbef7fe640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 0x7fdbdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.030+0000 7fdbef7fe640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 0x7fdbdc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4006a90 tx=0x7fdbe4006a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.034+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdbe007a240 con 0x7fdbf00caa60 2024-04-26T17:58:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.261+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fdbf0076d20 con 0x7fdbf00caa60 2024-04-26T17:58:36.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.552+0000 7fdbecff9640 1 -- 172.21.15.12:0/4241988520 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fdbe0079b40 con 0x7fdbf00caa60 2024-04-26T17:58:36.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 msgr2=0x7fdbdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 0x7fdbdc06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4006a90 tx=0x7fdbe4006a20 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 msgr2=0x7fdbf00b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00098c0 tx=0x7fdbe00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 shutdown_connections 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdbf0156010 0x7fdbf01f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdbdc06c8f0 0x7fdbdc06edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdbf00cfec0 0x7fdbf01f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 --2- 172.21.15.12:0/4241988520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf00caa60 0x7fdbf00b4840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 >> 172.21.15.12:0/4241988520 conn(0x7fdbf006fe70 msgr2=0x7fdbf00cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.554+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 shutdown_connections 2024-04-26T17:58:36.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.555+0000 7fdbf6893640 1 -- 172.21.15.12:0/4241988520 wait complete. 2024-04-26T17:58:36.570 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-04-26T17:58:36.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T17:58:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.677+0000 7f76dbba4640 1 Processor -- start 2024-04-26T17:58:36.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.677+0000 7f76dbba4640 1 -- start start 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76dbba4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 0x7f76d415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76dbba4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76d40d18f0 0x7f76d40c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76dbba4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76d40ce5e0 con 0x7f76d40cd620 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76dbba4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40ce8c0 con 0x7f76d40d18f0 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76dbba4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40ceba0 con 0x7f76d40d1510 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76d40d18f0 0x7f76d40c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76da141640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f76d40cd620 0x7f76d40cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60612/0 (socket says 172.21.15.12:60612) 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76d40d18f0 0x7f76d40c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42880/0 (socket says 172.21.15.12:42880) 2024-04-26T17:58:36.678 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76da141640 1 -- 172.21.15.12:0/3222604269 learned_addr learned my addr 172.21.15.12:0/3222604269 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d9940640 1 --2- 172.21.15.12:0/3222604269 >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 0x7f76d415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 -- 172.21.15.12:0/3222604269 >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 msgr2=0x7f76d415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 --2- 172.21.15.12:0/3222604269 >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 0x7f76d415fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 -- 172.21.15.12:0/3222604269 >> v1:172.21.15.12:6789/0 conn(0x7f76d40cd620 legacy=0x7f76d40cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d893e640 1 -- 172.21.15.12:0/3222604269 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147636099 0 0) 0x7f76d40ce5e0 con 0x7f76d40cd620 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d913f640 1 -- 172.21.15.12:0/3222604269 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d415f100 con 0x7f76d40d18f0 2024-04-26T17:58:36.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.678+0000 7f76d9940640 1 --2- 172.21.15.12:0/3222604269 >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 0x7f76d415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.679+0000 7f76d913f640 1 --2- 172.21.15.12:0/3222604269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d40c61f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76d4073890 tx=0x7f76c402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b03a9e72f27267 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.679+0000 7f76d893e640 1 -- 172.21.15.12:0/3222604269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4037070 con 0x7f76d40d18f0 2024-04-26T17:58:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.679+0000 7f76d893e640 1 -- 172.21.15.12:0/3222604269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4032440 con 0x7f76d40d18f0 2024-04-26T17:58:36.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.679+0000 7f76d893e640 1 -- 172.21.15.12:0/3222604269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4032810 con 0x7f76d40d18f0 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 -- 172.21.15.12:0/3222604269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 msgr2=0x7f76d40c61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 --2- 172.21.15.12:0/3222604269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d40c61f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f76d4073890 tx=0x7f76c402a230 comp rx=0 tx=0).stop 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 -- 172.21.15.12:0/3222604269 shutdown_connections 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 --2- 172.21.15.12:0/3222604269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d40c61f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 --2- 172.21.15.12:0/3222604269 >> v2:172.21.15.100:3300/0 conn(0x7f76d40d1510 0x7f76d415fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 -- 172.21.15.12:0/3222604269 >> 172.21.15.12:0/3222604269 conn(0x7f76d4072930 msgr2=0x7f76d4072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 -- 172.21.15.12:0/3222604269 shutdown_connections 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.680+0000 7f76dbba4640 1 -- 172.21.15.12:0/3222604269 wait complete. 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.681+0000 7f76dbba4640 1 Processor -- start 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.681+0000 7f76dbba4640 1 -- start start 2024-04-26T17:58:36.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cd620 0x7f76d41f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76d40d1510 0x7f76d414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40ccc70 con 0x7f76d40d18f0 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f76d415f6c0 con 0x7f76d40cd620 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76dbba4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f76d4155860 con 0x7f76d40d1510 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42882/0 (socket says 172.21.15.12:42882) 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 -- 172.21.15.12:0/4166101006 learned_addr learned my addr 172.21.15.12:0/4166101006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76d913f640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76d40d1510 0x7f76d414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76d9940640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cd620 0x7f76d41f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 -- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76d40d1510 msgr2=0x7f76d414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76d40d1510 0x7f76d414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 -- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cd620 msgr2=0x7f76d41f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cd620 0x7f76d41f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 -- 172.21.15.12:0/4166101006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d415cc30 con 0x7f76d40d18f0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.682+0000 7f76da141640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00c480 tx=0x7f76cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.683+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc018070 con 0x7f76d40d18f0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.683+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc007500 con 0x7f76d40d18f0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.683+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d40d1040 con 0x7f76d40d18f0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.683+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc004a20 con 0x7f76d40d18f0 2024-04-26T17:58:36.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.683+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d414c310 con 0x7f76d40d18f0 2024-04-26T17:58:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.684+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d4076d20 con 0x7f76d40d18f0 2024-04-26T17:58:36.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.684+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76cc01b070 con 0x7f76d40d18f0 2024-04-26T17:58:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.685+0000 7f76ca7fc640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 0x7f76b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.685+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76cc08b0c0 con 0x7f76d40d18f0 2024-04-26T17:58:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.685+0000 7f76d9940640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 0x7f76b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:36.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.686+0000 7f76d9940640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 0x7f76b806ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76d0003fd0 tx=0x7f76d0003ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:36.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.689+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f76cc059300 con 0x7f76d40d18f0 2024-04-26T17:58:36.912 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:36.913+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f76d40cb680 con 0x7f76d40d18f0 2024-04-26T17:58:37.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.559+0000 7f76ca7fc640 1 -- 172.21.15.12:0/4166101006 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f76cc058c00 con 0x7f76d40d18f0 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.561+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 msgr2=0x7f76b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.561+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 0x7f76b806ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f76d0003fd0 tx=0x7f76d0003ce0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.561+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 msgr2=0x7f76d415d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.561+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00c480 tx=0x7f76cc00c940 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 shutdown_connections 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76d40d18f0 0x7f76d415d9d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f76b806c920 0x7f76b806ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f76d40d1510 0x7f76d414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 --2- 172.21.15.12:0/4166101006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76d40cd620 0x7f76d41f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 >> 172.21.15.12:0/4166101006 conn(0x7f76d4072930 msgr2=0x7f76d40c9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:37.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 shutdown_connections 2024-04-26T17:58:37.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.562+0000 7f76dbba4640 1 -- 172.21.15.12:0/4166101006 wait complete. 2024-04-26T17:58:37.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-26T17:58:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.683+0000 7f7e603c6640 1 Processor -- start 2024-04-26T17:58:37.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.683+0000 7f7e603c6640 1 -- start start 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e603c6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e580d18f0 0x7f7e5815fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e603c6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580ce5e0 con 0x7f7e580d1510 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e603c6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e580ce8c0 con 0x7f7e580cd620 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e603c6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7e580ceba0 con 0x7f7e580d18f0 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5e162640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7e580d1510 0x7f7e580cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60628/0 (socket says 172.21.15.12:60628) 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5e162640 1 -- 172.21.15.12:0/1065932422 learned_addr learned my addr 172.21.15.12:0/1065932422 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d961640 1 --2- 172.21.15.12:0/1065932422 >> v2:172.21.15.100:3300/0 conn(0x7f7e580d18f0 0x7f7e5815fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783840132 0 0) 0x7f7e580ce5e0 con 0x7f7e580d1510 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e44003520 con 0x7f7e580d1510 2024-04-26T17:58:37.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2031170183 0 0) 0x7f7e44003520 con 0x7f7e580d1510 2024-04-26T17:58:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d961640 1 -- 172.21.15.12:0/1065932422 >> v1:172.21.15.100:6789/0 conn(0x7f7e580cd620 legacy=0x7f7e58155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.684+0000 7f7e5d961640 1 -- 172.21.15.12:0/1065932422 >> v1:172.21.15.12:6789/0 conn(0x7f7e580d1510 legacy=0x7f7e580cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.685+0000 7f7e5d961640 1 -- 172.21.15.12:0/1065932422 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5815f100 con 0x7f7e580d18f0 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.685+0000 7f7e5d961640 1 --2- 172.21.15.12:0/1065932422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5815fbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e480097a0 tx=0x7f7e4802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a99db28839f3ee7c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.685+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48037070 con 0x7f7e580d18f0 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4802ace0 con 0x7f7e580d18f0 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e5d160640 1 -- 172.21.15.12:0/1065932422 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54001670 con 0x7f7e580d18f0 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 -- 172.21.15.12:0/1065932422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 msgr2=0x7f7e5815fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 --2- 172.21.15.12:0/1065932422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5815fbe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e480097a0 tx=0x7f7e4802a250 comp rx=0 tx=0).stop 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 -- 172.21.15.12:0/1065932422 shutdown_connections 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 --2- 172.21.15.12:0/1065932422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5815fbe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 -- 172.21.15.12:0/1065932422 >> 172.21.15.12:0/1065932422 conn(0x7f7e58072930 msgr2=0x7f7e58072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 -- 172.21.15.12:0/1065932422 shutdown_connections 2024-04-26T17:58:37.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.686+0000 7f7e603c6640 1 -- 172.21.15.12:0/1065932422 wait complete. 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.687+0000 7f7e603c6640 1 Processor -- start 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.687+0000 7f7e603c6640 1 -- start start 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e580d1510 0x7f7e58144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5814a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e580ccc70 con 0x7f7e580cd620 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5815f6c0 con 0x7f7e580d18f0 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e603c6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7e58155f70 con 0x7f7e580d1510 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42896/0 (socket says 172.21.15.12:42896) 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 -- 172.21.15.12:0/827673525 learned_addr learned my addr 172.21.15.12:0/827673525 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:37.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5d961640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e580d1510 0x7f7e58144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e963640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5814a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 -- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e580d1510 msgr2=0x7f7e58144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e580d1510 0x7f7e58144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 -- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 msgr2=0x7f7e5814a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5814a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.688+0000 7f7e5e162640 1 -- 172.21.15.12:0/827673525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e581f5940 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e5e162640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c780 tx=0x7f7e5400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54017070 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e54005ad0 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e581f50a0 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007070 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.689+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581f5660 con 0x7f7e580cd620 2024-04-26T17:58:37.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.690+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58076d20 con 0x7f7e580cd620 2024-04-26T17:58:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.691+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e5401a070 con 0x7f7e580cd620 2024-04-26T17:58:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.691+0000 7f7e4effd640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 0x7f7e3c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.691+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e5408b350 con 0x7f7e580cd620 2024-04-26T17:58:37.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.691+0000 7f7e5d961640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 0x7f7e3c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:37.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.692+0000 7f7e5d961640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 0x7f7e3c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e48034000 tx=0x7f7e4802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:37.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.695+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e54059440 con 0x7f7e580cd620 2024-04-26T17:58:37.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:37.921+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f7e580cc0e0 con 0x7f7e580cd620 2024-04-26T17:58:38.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.564+0000 7f7e4effd640 1 -- 172.21.15.12:0/827673525 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7f7e54058d40 con 0x7f7e580cd620 2024-04-26T17:58:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.566+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 msgr2=0x7f7e3c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.566+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 0x7f7e3c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7e48034000 tx=0x7f7e4802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.566+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 msgr2=0x7f7e581f13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.566+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c780 tx=0x7f7e5400cc40 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 shutdown_connections 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e580d18f0 0x7f7e5814a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7e3c06c920 0x7f7e3c06ede0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e580d1510 0x7f7e58144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 --2- 172.21.15.12:0/827673525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e580cd620 0x7f7e581f13d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 >> 172.21.15.12:0/827673525 conn(0x7f7e58072930 msgr2=0x7f7e580c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 shutdown_connections 2024-04-26T17:58:38.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.567+0000 7f7e603c6640 1 -- 172.21.15.12:0/827673525 wait complete. 2024-04-26T17:58:38.579 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T17:58:38.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.687+0000 7f9d1a8dc640 1 Processor -- start 2024-04-26T17:58:38.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d1a8dc640 1 -- start start 2024-04-26T17:58:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d1a8dc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d1415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d1a8dc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1415c2a0 con 0x7f9d140b0c00 2024-04-26T17:58:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d1a8dc640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d1415c580 con 0x7f9d14072fd0 2024-04-26T17:58:38.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d1a8dc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9d140b0fe0 con 0x7f9d140afda0 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.688+0000 7f9d13fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9d140b0c00 0x7f9d1415fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60638/0 (socket says 172.21.15.12:60638) 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 -- 172.21.15.12:0/230640708 learned_addr learned my addr 172.21.15.12:0/230640708 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d137fe640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d1415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199743287 0 0) 0x7f9d1415c2a0 con 0x7f9d140b0c00 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d00003520 con 0x7f9d140b0c00 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2029905309 0 0) 0x7f9d1415c580 con 0x7f9d14072fd0 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d1415c2a0 con 0x7f9d14072fd0 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3394067157 0 0) 0x7f9d00003520 con 0x7f9d140b0c00 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 msgr2=0x7f9d1415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d1415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 >> v1:172.21.15.100:6789/0 conn(0x7f9d14072fd0 legacy=0x7f9d14068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1415c860 con 0x7f9d140b0c00 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f9d04001670 con 0x7f9d140b0c00 2024-04-26T17:58:38.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d137fe640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d1415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 >> v1:172.21.15.12:6789/0 conn(0x7f9d140b0c00 legacy=0x7f9d1415fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d00003b70 0x7f9d00003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d00004d40 0x7f9d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d140b0fe0 con 0x7f9d00003b70 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0000ba70 con 0x7f9d00004d40 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0000bbf0 con 0x7f9d140afda0 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d00003b70 0x7f9d00003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d137fe640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d18e79640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d00004d40 0x7f9d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 -- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 msgr2=0x7f9d00004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d140afda0 0x7f9d00004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 -- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d00004d40 msgr2=0x7f9d000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:38.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d00004d40 0x7f9d000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.689+0000 7f9d13fff640 1 -- 172.21.15.12:0/230640708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d00003520 con 0x7f9d00003b70 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.690+0000 7f9d13fff640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d00003b70 0x7f9d00003f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c1c0 tx=0x7f9d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12fa7f0faba5623 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.690+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04007cc0 con 0x7f9d00003b70 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.690+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d04005af0 con 0x7f9d00003b70 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.690+0000 7f9d12ffd640 1 -- 172.21.15.12:0/230640708 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04007070 con 0x7f9d00003b70 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/230640708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d00003b70 msgr2=0x7f9d00003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/230640708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d00003b70 0x7f9d00003f70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c1c0 tx=0x7f9d00005830 comp rx=0 tx=0).stop 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d18e79640 1 -- 172.21.15.12:0/230640708 reap_dead start 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/230640708 shutdown_connections 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/230640708 >> 172.21.15.12:0/230640708 conn(0x7f9d140ce110 msgr2=0x7f9d140ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/230640708 shutdown_connections 2024-04-26T17:58:38.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.691+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/230640708 wait complete. 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.692+0000 7f9d1a8dc640 1 Processor -- start 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.692+0000 7f9d1a8dc640 1 -- start start 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d00003b70 0x7f9d140b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d14151cd0 0x7f9d1414ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1415f640 con 0x7f9d141539e0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1415cb40 con 0x7f9d14151cd0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d1a8dc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9d140687a0 con 0x7f9d00003b70 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42914/0 (socket says 172.21.15.12:42914) 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 -- 172.21.15.12:0/1506683056 learned_addr learned my addr 172.21.15.12:0/1506683056 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d18e79640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d14151cd0 0x7f9d1414ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d13fff640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d00003b70 0x7f9d140b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 -- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d00003b70 msgr2=0x7f9d140b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d00003b70 0x7f9d140b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 -- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d14151cd0 msgr2=0x7f9d1414ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d14151cd0 0x7f9d1414ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.693+0000 7f9d137fe640 1 -- 172.21.15.12:0/1506683056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d14159510 con 0x7f9d141539e0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d137fe640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc011560 tx=0x7f9cfc011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc004220 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc0043c0 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc015870 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1415ac70 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.694+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1415b550 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.695+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d14076d20 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.695+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cfc015a10 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.696+0000 7f9d10ff9640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 0x7f9cf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.696+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9cfc08c420 con 0x7f9d141539e0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.696+0000 7f9d13fff640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 0x7f9cf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:38.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.697+0000 7f9d13fff640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 0x7f9cf406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d04032000 tx=0x7f9d04009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:38.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.700+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9cfc019030 con 0x7f9d141539e0 2024-04-26T17:58:38.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.929+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d1406fad0 con 0x7f9d141539e0 2024-04-26T17:58:38.929 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.929+0000 7f9d10ff9640 1 -- 172.21.15.12:0/1506683056 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f9cfc059ec0 con 0x7f9d141539e0 2024-04-26T17:58:38.929 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:38.929 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:38.929 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 msgr2=0x7f9cf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 0x7f9cf406edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9d04032000 tx=0x7f9d04009030 comp rx=0 tx=0).stop 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 msgr2=0x7f9d141529c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc011560 tx=0x7f9cfc011a20 comp rx=0 tx=0).stop 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 shutdown_connections 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d14151cd0 0x7f9d1414ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9d141539e0 0x7f9d141529c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9cf406c8f0 0x7f9cf406edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 --2- 172.21.15.12:0/1506683056 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9d00003b70 0x7f9d140b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.931+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 >> 172.21.15.12:0/1506683056 conn(0x7f9d140ce110 msgr2=0x7f9d14068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.932+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 shutdown_connections 2024-04-26T17:58:38.932 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:38.932+0000 7f9d1a8dc640 1 -- 172.21.15.12:0/1506683056 wait complete. 2024-04-26T17:58:38.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:39.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.044+0000 7fbc2f647640 1 Processor -- start 2024-04-26T17:58:39.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.044+0000 7fbc2f647640 1 -- start start 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2f647640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc28153e40 0x7fbc280702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2f647640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc280c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2f647640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc280c9090 con 0x7fbc280c7d80 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2f647640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbc280ca920 con 0x7fbc28153e40 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2f647640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280731f0 con 0x7fbc2806ced0 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2d3e3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc28153e40 0x7fbc280702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2cbe2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc280c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2d3e3640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc28153e40 0x7fbc280702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:40312/0 (socket says 172.21.15.12:40312) 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2dbe4640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbc280c7d80 0x7fbc28071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44838/0 (socket says 172.21.15.12:44838) 2024-04-26T17:58:39.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.045+0000 7fbc2d3e3640 1 -- 172.21.15.12:0/2837366368 learned_addr learned my addr 172.21.15.12:0/2837366368 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc1ffff640 1 -- 172.21.15.12:0/2837366368 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706029150 0 0) 0x7fbc280c9090 con 0x7fbc280c7d80 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc1ffff640 1 -- 172.21.15.12:0/2837366368 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc14003520 con 0x7fbc280c7d80 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2d3e3640 1 -- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 msgr2=0x7fbc280c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc280c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2d3e3640 1 -- 172.21.15.12:0/2837366368 >> v1:172.21.15.100:6789/0 conn(0x7fbc280c7d80 legacy=0x7fbc28071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2d3e3640 1 -- 172.21.15.12:0/2837366368 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc280c8ad0 con 0x7fbc28153e40 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2cbe2640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc280c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.046+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc280702c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009870 tx=0x7fbc2402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809e989ed5f388ca server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc1ffff640 1 -- 172.21.15.12:0/2837366368 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24037070 con 0x7fbc28153e40 2024-04-26T17:58:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc1ffff640 1 -- 172.21.15.12:0/2837366368 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc24032440 con 0x7fbc28153e40 2024-04-26T17:58:39.048 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc1ffff640 1 -- 172.21.15.12:0/2837366368 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24032810 con 0x7fbc28153e40 2024-04-26T17:58:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 -- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 msgr2=0x7fbc280702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc280702c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009870 tx=0x7fbc2402a270 comp rx=0 tx=0).stop 2024-04-26T17:58:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 -- 172.21.15.12:0/2837366368 shutdown_connections 2024-04-26T17:58:39.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc280c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2837366368 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc280702c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 -- 172.21.15.12:0/2837366368 >> 172.21.15.12:0/2837366368 conn(0x7fbc28068090 msgr2=0x7fbc28068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 -- 172.21.15.12:0/2837366368 shutdown_connections 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.047+0000 7fbc2f647640 1 -- 172.21.15.12:0/2837366368 wait complete. 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.048+0000 7fbc2f647640 1 Processor -- start 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.048+0000 7fbc2f647640 1 -- start start 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc281edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc281501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc28070a90 con 0x7fbc280c7d80 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc280734d0 con 0x7fbc28153e40 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2f647640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc280ca5c0 con 0x7fbc2806ced0 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2cbe2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2cbe2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42928/0 (socket says 172.21.15.12:42928) 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2cbe2640 1 -- 172.21.15.12:0/2361194145 learned_addr learned my addr 172.21.15.12:0/2361194145 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc281edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.049+0000 7fbc2dbe4640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc281501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 -- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 msgr2=0x7fbc281edd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc281edd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 -- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 msgr2=0x7fbc281501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc281501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 -- 172.21.15.12:0/2361194145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc280cd200 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2dbe4640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc281501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc281edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2cbe2640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800dcf0 tx=0x7fbc18010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18010da0 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1801d070 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc180186a0 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc280cd4e0 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.050+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc280cdaa0 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.051+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc28076d20 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.052+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc18016050 con 0x7fbc280c7d80 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.052+0000 7fbc1dffb640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.052+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbc1808fab0 con 0x7fbc280c7d80 2024-04-26T17:58:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.052+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.053+0000 7fbc2d3e3640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc24034000 tx=0x7fbc2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.056+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc18026020 con 0x7fbc280c7d80 2024-04-26T17:58:39.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.242+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc28073760 con 0x7fbc280c7d80 2024-04-26T17:58:39.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.243+0000 7fbc1dffb640 1 -- 172.21.15.12:0/2361194145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fbc18014040 con 0x7fbc280c7d80 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:39.243 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:39.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 msgr2=0x7fbc0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbc24034000 tx=0x7fbc2402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 msgr2=0x7fbc2815adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbc1800dcf0 tx=0x7fbc18010490 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 shutdown_connections 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc28153e40 0x7fbc281501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc280c7d80 0x7fbc2815adf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc0c06c8f0 0x7fbc0c06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 --2- 172.21.15.12:0/2361194145 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2806ced0 0x7fbc281edd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 >> 172.21.15.12:0/2361194145 conn(0x7fbc28068090 msgr2=0x7fbc28152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 shutdown_connections 2024-04-26T17:58:39.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.245+0000 7fbc2f647640 1 -- 172.21.15.12:0/2361194145 wait complete. 2024-04-26T17:58:39.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:39.256 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.357+0000 7f65f6885640 1 Processor -- start 2024-04-26T17:58:39.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.357+0000 7f65f6885640 1 -- start start 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f6885640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65f00b6080 0x7f65f00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f6885640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00738c0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f6885640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00729d0 con 0x7f65f00ce100 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f6885640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f65f0072cb0 con 0x7f65f00b6080 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f4e22640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65f00b6080 0x7f65f00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65ef7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65f00cc4f0 0x7f65f00b5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60642/0 (socket says 172.21.15.12:60642) 2024-04-26T17:58:39.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65ef7fe640 1 -- 172.21.15.12:0/2370467329 learned_addr learned my addr 172.21.15.12:0/2370467329 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f4e22640 1 -- 172.21.15.12:0/2370467329 >> v1:172.21.15.100:6789/0 conn(0x7f65f00ce100 legacy=0x7f65f015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f4e22640 1 -- 172.21.15.12:0/2370467329 >> v1:172.21.15.12:6789/0 conn(0x7f65f00cc4f0 legacy=0x7f65f00b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.358+0000 7f65f4e22640 1 -- 172.21.15.12:0/2370467329 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0072f90 con 0x7f65f00b6080 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65f4e22640 1 --2- 172.21.15.12:0/2370467329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00b6080 0x7f65f00ce4e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421e78e834aef57b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65eeffd640 1 -- 172.21.15.12:0/2370467329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8031600 con 0x7f65f00b6080 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65eeffd640 1 -- 172.21.15.12:0/2370467329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e80317a0 con 0x7f65f00b6080 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65eeffd640 1 -- 172.21.15.12:0/2370467329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8031b70 con 0x7f65f00b6080 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65f6885640 1 -- 172.21.15.12:0/2370467329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00b6080 msgr2=0x7f65f00ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65f6885640 1 --2- 172.21.15.12:0/2370467329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00b6080 0x7f65f00ce4e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009d90 tx=0x7f65e802a610 comp rx=0 tx=0).stop 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.359+0000 7f65f6885640 1 -- 172.21.15.12:0/2370467329 shutdown_connections 2024-04-26T17:58:39.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.360+0000 7f65f6885640 1 --2- 172.21.15.12:0/2370467329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00b6080 0x7f65f00ce4e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.360+0000 7f65f6885640 1 -- 172.21.15.12:0/2370467329 >> 172.21.15.12:0/2370467329 conn(0x7f65f0068270 msgr2=0x7f65f0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.360+0000 7f65f6885640 1 -- 172.21.15.12:0/2370467329 shutdown_connections 2024-04-26T17:58:39.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.360+0000 7f65f6885640 1 -- 172.21.15.12:0/2370467329 wait complete. 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.361+0000 7f65f6885640 1 Processor -- start 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.361+0000 7f65f6885640 1 -- start start 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65f00b6080 0x7f65f01577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65f00ce100 0x7f65f0149c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0156360 con 0x7f65f00cc4f0 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f65f0073550 con 0x7f65f00ce100 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00cd230 con 0x7f65f00b6080 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42934/0 (socket says 172.21.15.12:42934) 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 -- 172.21.15.12:0/1224465733 learned_addr learned my addr 172.21.15.12:0/1224465733 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f4e22640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65f00ce100 0x7f65f0149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65effff640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65f00b6080 0x7f65f01577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 -- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65f00b6080 msgr2=0x7f65f01577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65f00b6080 0x7f65f01577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 -- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65f00ce100 msgr2=0x7f65f0149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65f00ce100 0x7f65f0149c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 -- 172.21.15.12:0/1224465733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0157180 con 0x7f65f00cc4f0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ef7fe640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c430 tx=0x7f65e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0017070 con 0x7f65f00cc4f0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e0005ce0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f0157460 con 0x7f65f00cc4f0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00072f0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.362+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f00cb1c0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.363+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f008e2b0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.364+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65e001a070 con 0x7f65f00cc4f0 2024-04-26T17:58:39.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.364+0000 7f65ecff9640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 0x7f65d006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.364+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65e008b240 con 0x7f65f00cc4f0 2024-04-26T17:58:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.364+0000 7f65effff640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 0x7f65d006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.365+0000 7f65effff640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 0x7f65d006ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006fd0 tx=0x7f65d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.369+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f65f008e2b0 con 0x7f65f00cc4f0 2024-04-26T17:58:39.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.549+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65f01438e0 con 0x7f65d006c920 2024-04-26T17:58:39.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.558+0000 7f65ecff9640 1 -- 172.21.15.12:0/1224465733 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f65f01438e0 con 0x7f65d006c920 2024-04-26T17:58:39.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:39.563 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 msgr2=0x7f65d006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 0x7f65d006ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f65d8006fd0 tx=0x7f65d8008040 comp rx=0 tx=0).stop 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 msgr2=0x7f65f0157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c430 tx=0x7f65e000c8f0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 shutdown_connections 2024-04-26T17:58:39.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65f00ce100 0x7f65f0149c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65f00cc4f0 0x7f65f0157f70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f65d006c920 0x7f65d006ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 --2- 172.21.15.12:0/1224465733 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f65f00b6080 0x7f65f01577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 >> 172.21.15.12:0/1224465733 conn(0x7f65f0068270 msgr2=0x7f65f0151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 shutdown_connections 2024-04-26T17:58:39.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.562+0000 7f65f6885640 1 -- 172.21.15.12:0/1224465733 wait complete. 2024-04-26T17:58:39.572 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-04-26T17:58:37.880085+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003220"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:39.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.714+0000 7efd15ff2640 1 Processor -- start 2024-04-26T17:58:39.714 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 -- start start 2024-04-26T17:58:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd10153be0 0x7efd100c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd100c9770 0x7efd100c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd10076780 con 0x7efd10074330 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7efd100c8750 con 0x7efd100c9770 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd15ff2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7efd100c9230 con 0x7efd10153be0 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd0ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd100c9770 0x7efd100c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.715+0000 7efd0effd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efd10074330 0x7efd10159930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60646/0 (socket says 172.21.15.12:60646) 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0effd640 1 -- 172.21.15.12:0/635150214 learned_addr learned my addr 172.21.15.12:0/635150214 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd100c9770 0x7efd100c9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42948/0 (socket says 172.21.15.12:42948) 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0f7fe640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd10153be0 0x7efd100c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 -- 172.21.15.12:0/635150214 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd10153be0 msgr2=0x7efd100c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd10153be0 0x7efd100c79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 -- 172.21.15.12:0/635150214 >> v1:172.21.15.12:6789/0 conn(0x7efd10074330 legacy=0x7efd10159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 -- 172.21.15.12:0/635150214 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd100c8470 con 0x7efd100c9770 2024-04-26T17:58:39.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.716+0000 7efd0ffff640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd100c9770 0x7efd100c9c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd08009d90 tx=0x7efd0802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209fab3422c3bdcb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.717 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd0e7fc640 1 -- 172.21.15.12:0/635150214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08007740 con 0x7efd100c9770 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd0e7fc640 1 -- 172.21.15.12:0/635150214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd080078e0 con 0x7efd100c9770 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd0e7fc640 1 -- 172.21.15.12:0/635150214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08007cb0 con 0x7efd100c9770 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 -- 172.21.15.12:0/635150214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd100c9770 msgr2=0x7efd100c9c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd100c9770 0x7efd100c9c00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efd08009d90 tx=0x7efd0802a6f0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 -- 172.21.15.12:0/635150214 shutdown_connections 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd100c9770 0x7efd100c9c00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 --2- 172.21.15.12:0/635150214 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd10153be0 0x7efd100c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 -- 172.21.15.12:0/635150214 >> 172.21.15.12:0/635150214 conn(0x7efd100cd8d0 msgr2=0x7efd100cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 -- 172.21.15.12:0/635150214 shutdown_connections 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.717+0000 7efd15ff2640 1 -- 172.21.15.12:0/635150214 wait complete. 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.718+0000 7efd15ff2640 1 Processor -- start 2024-04-26T17:58:39.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 -- start start 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10074330 0x7efd101557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd100c9770 0x7efd101e34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd10072d40 con 0x7efd10153be0 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd100c94d0 con 0x7efd10074330 2024-04-26T17:58:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd15ff2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7efd1015a040 con 0x7efd100c9770 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd0ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42952/0 (socket says 172.21.15.12:42952) 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.719+0000 7efd0ffff640 1 -- 172.21.15.12:0/3870789993 learned_addr learned my addr 172.21.15.12:0/3870789993 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0f7fe640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10074330 0x7efd101557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0effd640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd100c9770 0x7efd101e34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 -- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd100c9770 msgr2=0x7efd101e34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd100c9770 0x7efd101e34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 -- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10074330 msgr2=0x7efd101557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10074330 0x7efd101557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 -- 172.21.15.12:0/3870789993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd101efb00 con 0x7efd10153be0 2024-04-26T17:58:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd0ffff640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd08009eb0 tx=0x7efd08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd08040070 con 0x7efd10153be0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd08031bc0 con 0x7efd10153be0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd101efdc0 con 0x7efd10153be0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0803c420 con 0x7efd10153be0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.720+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd101f0380 con 0x7efd10153be0 2024-04-26T17:58:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.721+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd10076d20 con 0x7efd10153be0 2024-04-26T17:58:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.722+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd08039040 con 0x7efd10153be0 2024-04-26T17:58:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.722+0000 7efcf7fff640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 0x7efcfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.722+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd080ad420 con 0x7efd10153be0 2024-04-26T17:58:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.722+0000 7efd0f7fe640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 0x7efcfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.723+0000 7efd0f7fe640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 0x7efcfc06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd00006fd0 tx=0x7efd00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.727+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd0807b510 con 0x7efd10153be0 2024-04-26T17:58:39.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.910+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd1014b6f0 con 0x7efcfc06c920 2024-04-26T17:58:39.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.918+0000 7efcf7fff640 1 -- 172.21.15.12:0/3870789993 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7efd1014b6f0 con 0x7efcfc06c920 2024-04-26T17:58:39.921 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:39.923 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 msgr2=0x7efcfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 0x7efcfc06ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efd00006fd0 tx=0x7efd00008040 comp rx=0 tx=0).stop 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 msgr2=0x7efd101e3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efd08009eb0 tx=0x7efd08004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 shutdown_connections 2024-04-26T17:58:39.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd10153be0 0x7efd101e3a30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efcfc06c920 0x7efcfc06ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd100c9770 0x7efd101e34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 --2- 172.21.15.12:0/3870789993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd10074330 0x7efd101557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 >> 172.21.15.12:0/3870789993 conn(0x7efd100cd8d0 msgr2=0x7efd1006ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 shutdown_connections 2024-04-26T17:58:39.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:39.921+0000 7efd15ff2640 1 -- 172.21.15.12:0/3870789993 wait complete. 2024-04-26T17:58:39.932 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-26T17:58:39.880669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:39.937 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:39.937 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T17:58:39.937 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T17:58:39.937 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T17:58:39.938 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T17:58:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.074+0000 7efd237ec640 1 Processor -- start 2024-04-26T17:58:40.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.074+0000 7efd237ec640 1 -- start start 2024-04-26T17:58:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd237ec640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd1c156180 0x7efd1c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd237ec640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c0cd840 0x7efd1c0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd237ec640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd1c15f2a0 con 0x7efd1c155da0 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd237ec640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7efd1c15cbc0 con 0x7efd1c156180 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd237ec640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c0cc730 con 0x7efd1c0cd840 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd1c156180 0x7efd1c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd21d89640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c0cd840 0x7efd1c0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efd1c156180 0x7efd1c15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:40368/0 (socket says 172.21.15.12:40368) 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 -- 172.21.15.12:0/1124260971 learned_addr learned my addr 172.21.15.12:0/1124260971 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 -- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c0cd840 msgr2=0x7efd1c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 --2- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c0cd840 0x7efd1c0c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 -- 172.21.15.12:0/1124260971 >> v1:172.21.15.100:6789/0 conn(0x7efd1c155da0 legacy=0x7efd1c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.075+0000 7efd20d87640 1 -- 172.21.15.12:0/1124260971 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c15f580 con 0x7efd1c156180 2024-04-26T17:58:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.076+0000 7efd20d87640 1 --2- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c156180 0x7efd1c15c680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009870 tx=0x7efd0c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b4eabc266a53cc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.076+0000 7efd13fff640 1 -- 172.21.15.12:0/1124260971 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c037070 con 0x7efd1c156180 2024-04-26T17:58:40.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.076+0000 7efd13fff640 1 -- 172.21.15.12:0/1124260971 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c032440 con 0x7efd1c156180 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.076+0000 7efd13fff640 1 -- 172.21.15.12:0/1124260971 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c032810 con 0x7efd1c156180 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 -- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c156180 msgr2=0x7efd1c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 --2- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c156180 0x7efd1c15c680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009870 tx=0x7efd0c02a1c0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 -- 172.21.15.12:0/1124260971 shutdown_connections 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 --2- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c156180 0x7efd1c15c680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 --2- 172.21.15.12:0/1124260971 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c0cd840 0x7efd1c0c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 -- 172.21.15.12:0/1124260971 >> 172.21.15.12:0/1124260971 conn(0x7efd1c068090 msgr2=0x7efd1c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 -- 172.21.15.12:0/1124260971 shutdown_connections 2024-04-26T17:58:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.077+0000 7efd237ec640 1 -- 172.21.15.12:0/1124260971 wait complete. 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.078+0000 7efd237ec640 1 Processor -- start 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.078+0000 7efd237ec640 1 -- start start 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c155da0 0x7efd1c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c1551b0 0x7efd1c154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c0d19d0 con 0x7efd1c0cd840 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c15fb40 con 0x7efd1c1551b0 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd237ec640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7efd1c0d1b50 con 0x7efd1c155da0 2024-04-26T17:58:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42966/0 (socket says 172.21.15.12:42966) 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 -- 172.21.15.12:0/3104680036 learned_addr learned my addr 172.21.15.12:0/3104680036 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21d89640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c1551b0 0x7efd1c154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd20d87640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c155da0 0x7efd1c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 -- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c155da0 msgr2=0x7efd1c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c155da0 0x7efd1c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 -- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c1551b0 msgr2=0x7efd1c154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c1551b0 0x7efd1c154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 -- 172.21.15.12:0/3104680036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c1e57d0 con 0x7efd1c0cd840 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.079+0000 7efd21588640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c430 tx=0x7efd1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.080+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd180052d0 con 0x7efd1c0cd840 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.080+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd18005490 con 0x7efd1c0cd840 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.080+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1c1f2320 con 0x7efd1c0cd840 2024-04-26T17:58:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.080+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd18007260 con 0x7efd1c0cd840 2024-04-26T17:58:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.080+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1c1f25c0 con 0x7efd1c0cd840 2024-04-26T17:58:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.081+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1c076d20 con 0x7efd1c0cd840 2024-04-26T17:58:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.081+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd18007400 con 0x7efd1c0cd840 2024-04-26T17:58:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.081+0000 7efd11ffb640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 0x7efd0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.081+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd1808b290 con 0x7efd1c0cd840 2024-04-26T17:58:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.082+0000 7efd20d87640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 0x7efd0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.082+0000 7efd20d87640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 0x7efd0006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd0c034000 tx=0x7efd0c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.086+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efd18058dc0 con 0x7efd1c0cd840 2024-04-26T17:58:40.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.319+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7efd1c0cd330 con 0x7efd1c0cd840 2024-04-26T17:58:40.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.322+0000 7efd11ffb640 1 -- 172.21.15.12:0/3104680036 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174142 (secure 0 0 0) 0x7efd1805d0c0 con 0x7efd1c0cd840 2024-04-26T17:58:40.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 msgr2=0x7efd0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 0x7efd0006edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efd0c034000 tx=0x7efd0c02e000 comp rx=0 tx=0).stop 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 msgr2=0x7efd1c0d1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efd1800c430 tx=0x7efd1800c8f0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 shutdown_connections 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd1c1551b0 0x7efd1c154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efd0006c8f0 0x7efd0006edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7efd1c155da0 0x7efd1c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 --2- 172.21.15.12:0/3104680036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd1c0cd840 0x7efd1c0d1150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 >> 172.21.15.12:0/3104680036 conn(0x7efd1c068090 msgr2=0x7efd1c14bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 shutdown_connections 2024-04-26T17:58:40.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.325+0000 7efd237ec640 1 -- 172.21.15.12:0/3104680036 wait complete. 2024-04-26T17:58:40.335 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":1835507235},{"type":"v1","addr":"172.21.15.100:6833","nonce":1835507235}]},"active_addr":"172.21.15.100:6833/1835507235","active_change":"2024-04-26T17:57:53.863524+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":881197701}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1366558320}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":814247947}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1621019811}]}]} 2024-04-26T17:58:40.339 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T17:58:40.339 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T17:58:40.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.440+0000 7fafbda47640 1 Processor -- start 2024-04-26T17:58:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafbda47640 1 -- start start 2024-04-26T17:58:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafbda47640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafb80735c0 0x7fafb815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.440 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafbda47640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb8073a30 con 0x7fafb815d020 2024-04-26T17:58:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafbda47640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80c6330 con 0x7fafb8155c90 2024-04-26T17:58:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafbda47640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fafb8156070 con 0x7fafb80735c0 2024-04-26T17:58:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafb77fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fafb815d020 0x7fafb81664b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60652/0 (socket says 172.21.15.12:60652) 2024-04-26T17:58:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.441+0000 7fafb77fe640 1 -- 172.21.15.12:0/3727688319 learned_addr learned my addr 172.21.15.12:0/3727688319 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb67fc640 1 --2- 172.21.15.12:0/3727688319 >> v2:172.21.15.100:3300/0 conn(0x7fafb80735c0 0x7fafb815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174485025 0 0) 0x7fafa8001490 con 0x7fafb815d020 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003520 con 0x7fafb815d020 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb67fc640 1 -- 172.21.15.12:0/3727688319 >> v1:172.21.15.100:6789/0 conn(0x7fafb8155c90 legacy=0x7fafb80d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb67fc640 1 -- 172.21.15.12:0/3727688319 >> v1:172.21.15.12:6789/0 conn(0x7fafb815d020 legacy=0x7fafb81664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877802510 0 0) 0x7fafb80c6330 con 0x7fafb8155c90 2024-04-26T17:58:40.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.442+0000 7fafb67fc640 1 -- 172.21.15.12:0/3727688319 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80c6610 con 0x7fafb80735c0 2024-04-26T17:58:40.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.443+0000 7fafb67fc640 1 --2- 172.21.15.12:0/3727688319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb815c5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097a0 tx=0x7fafac02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8479d3ee22ac603a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.443+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac037070 con 0x7fafb80735c0 2024-04-26T17:58:40.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.443+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac032640 con 0x7fafb80735c0 2024-04-26T17:58:40.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.443+0000 7fafb5ffb640 1 -- 172.21.15.12:0/3727688319 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0329f0 con 0x7fafb80735c0 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 -- 172.21.15.12:0/3727688319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 msgr2=0x7fafb815c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 --2- 172.21.15.12:0/3727688319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb815c5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097a0 tx=0x7fafac02a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 -- 172.21.15.12:0/3727688319 shutdown_connections 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 --2- 172.21.15.12:0/3727688319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb815c5b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 -- 172.21.15.12:0/3727688319 >> 172.21.15.12:0/3727688319 conn(0x7fafb8074030 msgr2=0x7fafb8074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 -- 172.21.15.12:0/3727688319 shutdown_connections 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.444+0000 7fafbda47640 1 -- 172.21.15.12:0/3727688319 wait complete. 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.445+0000 7fafbda47640 1 Processor -- start 2024-04-26T17:58:40.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.445+0000 7fafbda47640 1 -- start start 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.445+0000 7fafbda47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb8151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.445+0000 7fafbda47640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fafb8155c90 0x7fafb814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80c6eb0 con 0x7fafb815d020 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80c6bd0 con 0x7fafb80735c0 2024-04-26T17:58:40.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80c7190 con 0x7fafb8155c90 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42978/0 (socket says 172.21.15.12:42978) 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 -- 172.21.15.12:0/2118657907 learned_addr learned my addr 172.21.15.12:0/2118657907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb6ffd640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb8151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb67fc640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fafb8155c90 0x7fafb814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 -- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fafb8155c90 msgr2=0x7fafb814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fafb8155c90 0x7fafb814d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 -- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 msgr2=0x7fafb8151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb8151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 -- 172.21.15.12:0/2118657907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb8150d30 con 0x7fafb815d020 2024-04-26T17:58:40.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafb77fe640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ca30 tx=0x7fafa800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8017070 con 0x7fafb815d020 2024-04-26T17:58:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa800abd0 con 0x7fafb815d020 2024-04-26T17:58:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb8150ff0 con 0x7fafb815d020 2024-04-26T17:58:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8012400 con 0x7fafb815d020 2024-04-26T17:58:40.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.446+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb81528c0 con 0x7fafb815d020 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.447+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb8076d20 con 0x7fafb815d020 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.448+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafa801a070 con 0x7fafb815d020 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.448+0000 7faf9ffff640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 0x7fafa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.449+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fafa808bbe0 con 0x7fafb815d020 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.449+0000 7fafb6ffd640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 0x7fafa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.449+0000 7fafb6ffd640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 0x7fafa406ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000f60 tx=0x7fafb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.453+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fafb8073a30 con 0x7fafb815d020 2024-04-26T17:58:40.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.640+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafb80c7d90 con 0x7fafb815d020 2024-04-26T17:58:40.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.641+0000 7faf9ffff640 1 -- 172.21.15.12:0/2118657907 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fafa8059cd0 con 0x7fafb815d020 2024-04-26T17:58:40.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:40.641 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 msgr2=0x7fafa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 0x7fafa406ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fafb0000f60 tx=0x7fafb0009040 comp rx=0 tx=0).stop 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 msgr2=0x7fafb81f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fafa800ca30 tx=0x7fafa800cef0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 shutdown_connections 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fafb815d020 0x7fafb81f1680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fafa406c920 0x7fafa406ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fafb8155c90 0x7fafb814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 --2- 172.21.15.12:0/2118657907 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafb80735c0 0x7fafb8151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 >> 172.21.15.12:0/2118657907 conn(0x7fafb8074030 msgr2=0x7fafb815e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 shutdown_connections 2024-04-26T17:58:40.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.643+0000 7fafbda47640 1 -- 172.21.15.12:0/2118657907 wait complete. 2024-04-26T17:58:40.654 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T17:58:40.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:40.755 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.756+0000 7fd456083640 1 Processor -- start 2024-04-26T17:58:40.756 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.756+0000 7fd456083640 1 -- start start 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd456083640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4500745a0 0x7fd45015c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd456083640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd450158990 con 0x7fd450155ff0 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd456083640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4501563d0 con 0x7fd450070010 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd456083640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fd450073a00 con 0x7fd4500745a0 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd44ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4500745a0 0x7fd45015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd44ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4500745a0 0x7fd45015c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42988/0 (socket says 172.21.15.12:42988) 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd44f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd450155ff0 0x7fd45006c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60660/0 (socket says 172.21.15.12:60660) 2024-04-26T17:58:40.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.757+0000 7fd44ffff640 1 -- 172.21.15.12:0/2876828744 learned_addr learned my addr 172.21.15.12:0/2876828744 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:40.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.758+0000 7fd44ffff640 1 -- 172.21.15.12:0/2876828744 >> v1:172.21.15.100:6789/0 conn(0x7fd450070010 legacy=0x7fd450073e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:40.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.758+0000 7fd44ffff640 1 -- 172.21.15.12:0/2876828744 >> v1:172.21.15.12:6789/0 conn(0x7fd450155ff0 legacy=0x7fd45006c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.758+0000 7fd44ffff640 1 -- 172.21.15.12:0/2876828744 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd450158c30 con 0x7fd4500745a0 2024-04-26T17:58:40.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.758+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2876828744 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033328107 0 0) 0x7fd450158990 con 0x7fd450155ff0 2024-04-26T17:58:40.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.758+0000 7fd44ffff640 1 --2- 172.21.15.12:0/2876828744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd45015c910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e50 tx=0x7fd44802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24796f8f2f31150c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2876828744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448036070 con 0x7fd4500745a0 2024-04-26T17:58:40.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2876828744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd448031600 con 0x7fd4500745a0 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd44e7fc640 1 -- 172.21.15.12:0/2876828744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4480319d0 con 0x7fd4500745a0 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 -- 172.21.15.12:0/2876828744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 msgr2=0x7fd45015c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 --2- 172.21.15.12:0/2876828744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd45015c910 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e50 tx=0x7fd44802a760 comp rx=0 tx=0).stop 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 -- 172.21.15.12:0/2876828744 shutdown_connections 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 --2- 172.21.15.12:0/2876828744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd45015c910 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 -- 172.21.15.12:0/2876828744 >> 172.21.15.12:0/2876828744 conn(0x7fd4500ce110 msgr2=0x7fd4500ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 -- 172.21.15.12:0/2876828744 shutdown_connections 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.759+0000 7fd456083640 1 -- 172.21.15.12:0/2876828744 wait complete. 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.760+0000 7fd456083640 1 Processor -- start 2024-04-26T17:58:40.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.760+0000 7fd456083640 1 -- start start 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 0x7fd4500b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450155ff0 0x7fd4501ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501594b0 con 0x7fd4500745a0 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fd4501591d0 con 0x7fd450155ff0 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd456083640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fd450159790 con 0x7fd450070010 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd44effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd44effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42996/0 (socket says 172.21.15.12:42996) 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd44effd640 1 -- 172.21.15.12:0/1451640825 learned_addr learned my addr 172.21.15.12:0/1451640825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd44ffff640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450155ff0 0x7fd4501ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.761+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 0x7fd4500b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 -- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 msgr2=0x7fd4500b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 0x7fd4500b0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 -- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450155ff0 msgr2=0x7fd4501ef820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450155ff0 0x7fd4501ef820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 -- 172.21.15.12:0/1451640825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4501e53e0 con 0x7fd4500745a0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 0x7fd4500b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd44effd640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c430 tx=0x7fd44400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444011790 con 0x7fd4500745a0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444017070 con 0x7fd4500745a0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd450068ce0 con 0x7fd4500745a0 2024-04-26T17:58:40.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd444011bb0 con 0x7fd4500745a0 2024-04-26T17:58:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.762+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4500b1b80 con 0x7fd4500745a0 2024-04-26T17:58:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.763+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4500b44b0 con 0x7fd4500745a0 2024-04-26T17:58:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.763+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd44401c460 con 0x7fd4500745a0 2024-04-26T17:58:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.764+0000 7fd437fff640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 0x7fd43c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.764+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd44408bdc0 con 0x7fd4500745a0 2024-04-26T17:58:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.764+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 0x7fd43c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.765+0000 7fd44f7fe640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 0x7fd43c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.768+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd4500b44b0 con 0x7fd4500745a0 2024-04-26T17:58:40.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.953+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd450076d20 con 0x7fd4500745a0 2024-04-26T17:58:40.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.955+0000 7fd437fff640 1 -- 172.21.15.12:0/1451640825 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fd444059e20 con 0x7fd4500745a0 2024-04-26T17:58:40.954 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:40.954 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 msgr2=0x7fd43c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 0x7fd43c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd440000f60 tx=0x7fd440007ca0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 msgr2=0x7fd4500c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd44400c430 tx=0x7fd44400c8f0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 shutdown_connections 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd450155ff0 0x7fd4501ef820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4500745a0 0x7fd4500c7f00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fd43c06c8f0 0x7fd43c06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 --2- 172.21.15.12:0/1451640825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd450070010 0x7fd4500b0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 >> 172.21.15.12:0/1451640825 conn(0x7fd4500ce110 msgr2=0x7fd450152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 shutdown_connections 2024-04-26T17:58:40.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:40.957+0000 7fd456083640 1 -- 172.21.15.12:0/1451640825 wait complete. 2024-04-26T17:58:40.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T17:58:40.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T17:58:40.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T17:58:40.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-26T17:58:40.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-26T17:58:40.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-26T17:58:40.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-26T17:58:40.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.144+0000 7f0dfb539640 1 Processor -- start 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.144+0000 7f0dfb539640 1 -- start start 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.145+0000 7f0dfb539640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.145+0000 7f0dfb539640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 0x7f0df40c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.145+0000 7f0dfb539640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df40c7ea0 con 0x7f0df415a570 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.145+0000 7f0dfb539640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f0df40c8fe0 con 0x7f0df40c7340 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.145+0000 7f0dfb539640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0df40725a0 con 0x7f0df415a190 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36678/0 (socket says 172.21.15.12:36678) 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df9ad6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 0x7f0df40c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 -- 172.21.15.12:0/1005542151 learned_addr learned my addr 172.21.15.12:0/1005542151 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 -- 172.21.15.12:0/1005542151 >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 msgr2=0x7f0df40c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 --2- 172.21.15.12:0/1005542151 >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 0x7f0df40c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 -- 172.21.15.12:0/1005542151 >> v1:172.21.15.100:6789/0 conn(0x7f0df415a570 legacy=0x7f0df4073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.146+0000 7f0df92d5640 1 -- 172.21.15.12:0/1005542151 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df406f0e0 con 0x7f0df415a190 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f0df9ad6640 1 --2- 172.21.15.12:0/1005542151 >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 0x7f0df40c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f0df92d5640 1 --2- 172.21.15.12:0/1005542151 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009870 tx=0x7f0de402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b08cc1b90fd46cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f1b8d6c2640 1 Processor -- start 2024-04-26T17:58:41.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f1b8d6c2640 1 -- start start 2024-04-26T17:58:41.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7fac154a8640 1 Processor -- start 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f0debfff640 1 -- 172.21.15.12:0/1005542151 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4037070 con 0x7f0df415a190 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f0debfff640 1 -- 172.21.15.12:0/1005542151 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de4032440 con 0x7f0df415a190 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.147+0000 7f0debfff640 1 -- 172.21.15.12:0/1005542151 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de40327f0 con 0x7f0df415a190 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f900ab78640 1 Processor -- start 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f0dfb539640 1 -- 172.21.15.12:0/1005542151 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 msgr2=0x7f0df4160010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f0dfb539640 1 --2- 172.21.15.12:0/1005542151 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009870 tx=0x7f0de402a1a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f900ab78640 1 -- start start 2024-04-26T17:58:41.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 -- 172.21.15.12:0/1005542151 shutdown_connections 2024-04-26T17:58:41.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 --2- 172.21.15.12:0/1005542151 >> v2:172.21.15.100:3300/0 conn(0x7f0df40c7340 0x7f0df40c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 --2- 172.21.15.12:0/1005542151 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df415a190 0x7f0df4160010 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 -- 172.21.15.12:0/1005542151 >> 172.21.15.12:0/1005542151 conn(0x7f0df40686c0 msgr2=0x7f0df406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f1b8d6c2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1b800dd450 0x7f1b8004b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f1b8d6c2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800e6770 0x7f1b800e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f1b8d6c2640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b8004b840 con 0x7f1b800452d0 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f1b8d6c2640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f1b80007650 con 0x7f1b800dd450 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7f1b8d6c2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1b80006a40 con 0x7f1b800e6770 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f1b877fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1b800452d0 0x7f1b80045720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60666/0 (socket says 172.21.15.12:60666) 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f1b877fe640 1 -- 172.21.15.12:0/456605238 learned_addr learned my addr 172.21.15.12:0/456605238 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 -- 172.21.15.12:0/1005542151 shutdown_connections 2024-04-26T17:58:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f0dfb539640 1 -- 172.21.15.12:0/1005542151 wait complete. 2024-04-26T17:58:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933397678 0 0) 0x7f1b8004b840 con 0x7f1b800452d0 2024-04-26T17:58:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b78003520 con 0x7f1b800452d0 2024-04-26T17:58:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.149+0000 7f1b87fff640 1 --2- 172.21.15.12:0/456605238 >> v2:172.21.15.100:3300/0 conn(0x7f1b800dd450 0x7f1b8004b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1055325054 0 0) 0x7f1b78003520 con 0x7f1b800452d0 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f4032a19640 1 Processor -- start 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.148+0000 7fac154a8640 1 -- start start 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 0x7fac100c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 0x7fac100736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fac100c8bd0 con 0x7fac10073280 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fac100c3390 con 0x7fac100c3ea0 2024-04-26T17:58:41.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac154a8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fac1015b010 con 0x7fac100c29c0 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36698/0 (socket says 172.21.15.12:36698) 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 -- 172.21.15.12:0/1228302996 learned_addr learned my addr 172.21.15.12:0/1228302996 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac0f7fe640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 0x7fac100736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 -- 172.21.15.12:0/1228302996 >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 msgr2=0x7fac100c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac0ffff640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 0x7fac100c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 0x7fac100c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 -- 172.21.15.12:0/1228302996 >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 msgr2=0x7fac100736e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800e6770 msgr2=0x7f1b800e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800e6770 0x7f1b800e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 >> v2:172.21.15.100:3300/0 conn(0x7f1b800dd450 msgr2=0x7f1b8004b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 --2- 172.21.15.12:0/456605238 >> v2:172.21.15.100:3300/0 conn(0x7f1b800dd450 0x7f1b8004b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b80006d20 con 0x7f1b800452d0 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f1b880769f0 con 0x7f1b800452d0 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 >> v1:172.21.15.12:6789/0 conn(0x7f1b800452d0 legacy=0x7f1b80045720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b78003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b78004800 0x7f1b78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b780051c0 0x7f1b7800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b80007650 con 0x7f1b78004800 2024-04-26T17:58:41.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b80006a40 con 0x7f1b780039b0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1b7800c070 con 0x7f1b780051c0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b87fff640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b78003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f1b8cec1640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b780051c0 0x7f1b7800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b877fe640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b78004800 0x7f1b78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b87fff640 1 -- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b780051c0 msgr2=0x7f1b7800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b87fff640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b780051c0 0x7f1b7800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b87fff640 1 -- 172.21.15.12:0/456605238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b78004800 msgr2=0x7f1b78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b87fff640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b78004800 0x7f1b78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b87fff640 1 -- 172.21.15.12:0/456605238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b78003520 con 0x7f1b780039b0 2024-04-26T17:58:41.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f1b877fe640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b78004800 0x7f1b78004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f8b9e8cf640 1 Processor -- start 2024-04-26T17:58:41.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f8b9e8cf640 1 -- start start 2024-04-26T17:58:41.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7f4032a19640 1 -- start start 2024-04-26T17:58:41.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7fdf89019640 1 Processor -- start 2024-04-26T17:58:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 0x7fac100736e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.150+0000 7fac14ca7640 1 -- 172.21.15.12:0/1228302996 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac100c93b0 con 0x7fac100c29c0 2024-04-26T17:58:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7fac0ffff640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 0x7fac100c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f1b87fff640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b78003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400ba30 tx=0x7f1b78005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d28aaaf3d4623a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9e8cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b98072460 0x7f8b9806e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9e8cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b9806e630 0x7f8b981624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9e8cf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9806ea80 con 0x7f8b98068ad0 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9e8cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8b980c9450 con 0x7f8b98072460 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9e8cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8b980c85f0 con 0x7f8b9806e630 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032a19640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f402404f690 0x7f40240e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032a19640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f40240e6f50 0x7f40240ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032a19640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40240506f0 con 0x7f40240e6630 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032a19640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4024006cb0 con 0x7f402404f690 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032a19640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4024006f90 con 0x7f40240e6f50 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031a17640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f40240e6630 0x7f4024038800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44882/0 (socket says 172.21.15.12:44882) 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031a17640 1 -- 172.21.15.12:0/1603371254 learned_addr learned my addr 172.21.15.12:0/1603371254 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031216640 1 --2- 172.21.15.12:0/1603371254 >> v2:172.21.15.100:3300/0 conn(0x7f402404f690 0x7f40240e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4032218640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f40240e6f50 0x7f40240ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7fac14ca7640 1 --2- 172.21.15.12:0/1228302996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac100c7f90 tx=0x7fac0802c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e1de24c9f7dd30 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7fac0f7fe640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 0x7fac100736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b98072460 0x7f8b9806e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b98072460 0x7f8b9806e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43016/0 (socket says 172.21.15.12:43016) 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 -- 172.21.15.12:0/915499518 learned_addr learned my addr 172.21.15.12:0/915499518 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b9ce6c640 1 --2- 172.21.15.12:0/915499518 >> v2:172.21.15.100:3300/0 conn(0x7f8b9806e630 0x7f8b981624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7fdf89019640 1 -- start start 2024-04-26T17:58:41.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7fac0effd640 1 -- 172.21.15.12:0/1228302996 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0803a070 con 0x7fac100c29c0 2024-04-26T17:58:41.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7fac0effd640 1 -- 172.21.15.12:0/1228302996 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac08032480 con 0x7fac100c29c0 2024-04-26T17:58:41.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f0dfb539640 1 Processor -- start 2024-04-26T17:58:41.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.151+0000 7f0dfb539640 1 -- start start 2024-04-26T17:58:41.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 -- 172.21.15.12:0/915499518 >> v2:172.21.15.100:3300/0 conn(0x7f8b9806e630 msgr2=0x7f8b981624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.162 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 --2- 172.21.15.12:0/915499518 >> v2:172.21.15.100:3300/0 conn(0x7f8b9806e630 0x7f8b981624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74030070 con 0x7f1b780039b0 2024-04-26T17:58:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 -- 172.21.15.12:0/915499518 >> v1:172.21.15.100:6789/0 conn(0x7f8b98068ad0 legacy=0x7f8b981585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f8b977fe640 1 -- 172.21.15.12:0/915499518 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b980c88d0 con 0x7f8b98072460 2024-04-26T17:58:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7402ae10 con 0x7f1b780039b0 2024-04-26T17:58:41.163 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f1b86ffd640 1 -- 172.21.15.12:0/456605238 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7400b600 con 0x7f1b780039b0 2024-04-26T17:58:41.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f900ab78640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9004153d40 0x7f9004068b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f900ab78640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f900415a300 con 0x7f900415dac0 2024-04-26T17:58:41.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f900ab78640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f900415a5e0 con 0x7f9004153960 2024-04-26T17:58:41.164 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f900ab78640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f900415cd90 con 0x7f9004153d40 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f0dfb539640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df40c7340 0x7f0df4132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0dfb539640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 0x7f0df4133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0df8ad4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 0x7f0df4133830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0df8ad4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 0x7f0df4133830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43024/0 (socket says 172.21.15.12:43024) 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0df8ad4640 1 -- 172.21.15.12:0/448856609 learned_addr learned my addr 172.21.15.12:0/448856609 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0dfb539640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df415a570 0x7f0df4133d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0df92d5640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df40c7340 0x7f0df4132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0df406f380 con 0x7f0df415a190 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0df40c7bc0 con 0x7f0df415a570 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0df4073960 con 0x7f0df40c7340 2024-04-26T17:58:41.165 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f0df9ad6640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df415a570 0x7f0df4133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031216640 1 -- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f40240e6f50 msgr2=0x7f40240ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031216640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f40240e6f50 0x7f40240ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031216640 1 -- 172.21.15.12:0/1603371254 >> v1:172.21.15.100:6789/0 conn(0x7f40240e6630 legacy=0x7f4024038800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.152+0000 7f4031216640 1 -- 172.21.15.12:0/1603371254 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4024007270 con 0x7f402404f690 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f9009b76640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9004153960 0x7f90040c8a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44890/0 (socket says 172.21.15.12:44890) 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f9009b76640 1 -- 172.21.15.12:0/1994587956 learned_addr learned my addr 172.21.15.12:0/1994587956 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.166 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7f9009375640 1 --2- 172.21.15.12:0/1994587956 >> v2:172.21.15.100:3300/0 conn(0x7f9004153d40 0x7f9004068b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7fac0effd640 1 -- 172.21.15.12:0/1228302996 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08032830 con 0x7fac100c29c0 2024-04-26T17:58:41.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7fac154a8640 1 -- 172.21.15.12:0/1228302996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 msgr2=0x7fac100c2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.153+0000 7fac154a8640 1 --2- 172.21.15.12:0/1228302996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fac100c7f90 tx=0x7fac0802c7a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f4031216640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402404f690 0x7f40240e6a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f402c02e060 tx=0x7f402c0a78b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97851f8ceba2acb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 -- 172.21.15.12:0/1228302996 shutdown_connections 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 --2- 172.21.15.12:0/1228302996 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac100c29c0 0x7fac100c2e50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.12:3300/0 conn(0x7fac10073280 0x7fac100736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 --2- 172.21.15.12:0/1228302996 >> v2:172.21.15.100:3300/0 conn(0x7fac100c3ea0 0x7fac100c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 -- 172.21.15.12:0/1228302996 >> 172.21.15.12:0/1228302996 conn(0x7fac100c9a90 msgr2=0x7fac100c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 -- 172.21.15.12:0/1228302996 shutdown_connections 2024-04-26T17:58:41.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f8b977fe640 1 --2- 172.21.15.12:0/915499518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98072460 0x7f8b9806e0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b980c95d0 tx=0x7f8b9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a19d390d2ba6d7b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f4030a15640 1 -- 172.21.15.12:0/1603371254 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c0ad460 con 0x7f402404f690 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f4030a15640 1 -- 172.21.15.12:0/1603371254 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c0ad600 con 0x7f402404f690 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f4030a15640 1 -- 172.21.15.12:0/1603371254 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c0ada50 con 0x7f402404f690 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 239245792 0 0) 0x7f900415a300 con 0x7f900415dac0 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ff0003520 con 0x7f900415dac0 2024-04-26T17:58:41.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059362800 0 0) 0x7f900415a5e0 con 0x7f9004153960 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f900415a300 con 0x7f9004153960 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf89019640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf7c0d92b0 0x7fdf7c038640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf89019640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0378f0 0x7fdf7c038b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf89019640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf7c0376d0 con 0x7fdf7c037170 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf89019640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdf7c0502c0 con 0x7fdf7c0d92b0 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf89019640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c0505a0 con 0x7fdf7c0378f0 2024-04-26T17:58:41.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 msgr2=0x7f1b78003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f1b8d6c2640 1 --2- 172.21.15.12:0/456605238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b78003dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400ba30 tx=0x7f1b78005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f8b96ffd640 1 -- 172.21.15.12:0/915499518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90036070 con 0x7f8b98072460 2024-04-26T17:58:41.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f8b96ffd640 1 -- 172.21.15.12:0/915499518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b90031600 con 0x7f8b98072460 2024-04-26T17:58:41.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7f8b96ffd640 1 -- 172.21.15.12:0/915499518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b90036070 con 0x7f8b98072460 2024-04-26T17:58:41.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fdf837fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdf7c037170 0x7fdf7c0ded90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60678/0 (socket says 172.21.15.12:60678) 2024-04-26T17:58:41.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf837fe640 1 -- 172.21.15.12:0/2056120343 learned_addr learned my addr 172.21.15.12:0/2056120343 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf83fff640 1 --2- 172.21.15.12:0/2056120343 >> v2:172.21.15.100:3300/0 conn(0x7fdf7c0d92b0 0x7fdf7c038640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f1b8cec1640 1 -- 172.21.15.12:0/456605238 reap_dead start 2024-04-26T17:58:41.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf88818640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0378f0 0x7fdf7c038b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f6665e2a640 1 Processor -- start 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1966226590 0 0) 0x7f8ff0003520 con 0x7f900415dac0 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 >> v2:172.21.15.100:3300/0 conn(0x7f9004153d40 msgr2=0x7f9004068b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 --2- 172.21.15.12:0/1994587956 >> v2:172.21.15.100:3300/0 conn(0x7f9004153d40 0x7f9004068b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 >> v1:172.21.15.100:6789/0 conn(0x7f9004153960 legacy=0x7f90040c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f900415cfe0 con 0x7f900415dac0 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f8ff4001670 con 0x7f900415dac0 2024-04-26T17:58:41.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 >> v1:172.21.15.12:6789/0 conn(0x7f900415dac0 legacy=0x7f900406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/456605238 shutdown_connections 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/456605238 >> 172.21.15.12:0/456605238 conn(0x7f1b80050180 msgr2=0x7f1b80050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff0003b80 0x7f8ff0003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ff0004800 0x7f8ff0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 0x7f8ff000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f900415cd90 con 0x7f8ff0003b80 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff00104d0 con 0x7f8ff00051c0 2024-04-26T17:58:41.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff00106d0 con 0x7f8ff0004800 2024-04-26T17:58:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f6665e2a640 1 -- start start 2024-04-26T17:58:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df9ad6640 1 -- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df40c7340 msgr2=0x7f0df4132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df9ad6640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0df40c7340 0x7f0df4132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df9ad6640 1 -- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 msgr2=0x7f0df4133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 -- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402404f690 msgr2=0x7f40240e6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402404f690 0x7f40240e6a10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f402c02e060 tx=0x7f402c0a78b0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 -- 172.21.15.12:0/1603371254 shutdown_connections 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f402404f690 0x7f40240e6a10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 --2- 172.21.15.12:0/1603371254 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f40240e6f50 0x7f40240ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f4032a19640 1 -- 172.21.15.12:0/1603371254 >> 172.21.15.12:0/1603371254 conn(0x7f4024054520 msgr2=0x7f4024054930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df9ad6640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 0x7f0df4133830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df9ad6640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df4139830 con 0x7f0df415a570 2024-04-26T17:58:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f0df8ad4640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0df415a190 0x7f0df4133830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f900a377640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 0x7f8ff000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/915499518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98072460 msgr2=0x7f8b9806e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f0df9ad6640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df415a570 0x7f0df4133d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c540 tx=0x7f0df000ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f4032a19640 1 -- 172.21.15.12:0/1603371254 shutdown_connections 2024-04-26T17:58:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7f8b9e8cf640 1 --2- 172.21.15.12:0/915499518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98072460 0x7f8b9806e0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b980c95d0 tx=0x7f8b9002a6a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.154+0000 7fac154a8640 1 -- 172.21.15.12:0/1228302996 wait complete. 2024-04-26T17:58:41.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7fac154a8640 1 Processor -- start 2024-04-26T17:58:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0015070 con 0x7f0df415a570 2024-04-26T17:58:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/915499518 shutdown_connections 2024-04-26T17:58:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f8b9e8cf640 1 --2- 172.21.15.12:0/915499518 >> v2:172.21.15.100:3300/0 conn(0x7f8b9806e630 0x7f8b981624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f8b9e8cf640 1 --2- 172.21.15.12:0/915499518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98072460 0x7f8b9806e0f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/915499518 >> 172.21.15.12:0/915499518 conn(0x7f8b980686c0 msgr2=0x7f8b9806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df0004240 con 0x7f0df415a570 2024-04-26T17:58:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0003610 con 0x7f0df415a570 2024-04-26T17:58:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7fac154a8640 1 -- start start 2024-04-26T17:58:41.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f4032a19640 1 -- 172.21.15.12:0/1603371254 wait complete. 2024-04-26T17:58:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf83fff640 1 -- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0378f0 msgr2=0x7fdf7c038b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf83fff640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0378f0 0x7fdf7c038b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf83fff640 1 -- 172.21.15.12:0/2056120343 >> v1:172.21.15.12:6789/0 conn(0x7fdf7c037170 legacy=0x7fdf7c0ded90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.155+0000 7fdf83fff640 1 -- 172.21.15.12:0/2056120343 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c050880 con 0x7fdf7c0d92b0 2024-04-26T17:58:41.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7fdf83fff640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c0d92b0 0x7fdf7c038640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009790 tx=0x7fdf7802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e7b52c36b02651e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f9009b76640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff0003b80 0x7f8ff0003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.156+0000 7f6665e2a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66600cdc90 0x7f6660167490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f6665e2a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666015f190 con 0x7f6660155f70 2024-04-26T17:58:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f4032a19640 1 Processor -- start 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac10073280 0x7fac100c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 0x7fac10158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac100c3ea0 0x7fac101576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fac1015b590 con 0x7fac100c29c0 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac1015b2b0 con 0x7fac100c3ea0 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fac154a8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fac1015b870 con 0x7fac10073280 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fac0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 0x7fac10158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fdf82ffd640 1 -- 172.21.15.12:0/2056120343 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78037070 con 0x7fdf7c0d92b0 2024-04-26T17:58:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7fdf82ffd640 1 -- 172.21.15.12:0/2056120343 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf78032440 con 0x7fdf7c0d92b0 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f665f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6660155f70 0x7f666015f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60682/0 (socket says 172.21.15.12:60682) 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f665f7fe640 1 -- 172.21.15.12:0/4194315236 learned_addr learned my addr 172.21.15.12:0/4194315236 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f666015c970 con 0x7f66600c6530 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006194246 0 0) 0x7f666015f190 con 0x7f6660155f70 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f66600cc1c0 con 0x7f66600cdc90 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664c003520 con 0x7f6660155f70 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 738939129 0 0) 0x7f664c003520 con 0x7f6660155f70 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 >> v2:172.21.15.100:3300/0 conn(0x7f66600cdc90 msgr2=0x7f6660167490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/915499518 shutdown_connections 2024-04-26T17:58:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/915499518 wait complete. 2024-04-26T17:58:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 --2- 172.21.15.12:0/4194315236 >> v2:172.21.15.100:3300/0 conn(0x7f66600cdc90 0x7f6660167490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 >> v1:172.21.15.100:6789/0 conn(0x7f66600c6530 legacy=0x7f66600cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fac0f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 0x7fac10158420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43044/0 (socket says 172.21.15.12:43044) 2024-04-26T17:58:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fac0f7fe640 1 -- 172.21.15.12:0/478535437 learned_addr learned my addr 172.21.15.12:0/478535437 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600cc410 con 0x7f6660155f70 2024-04-26T17:58:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fdf89019640 1 -- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c0d92b0 msgr2=0x7fdf7c038640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fdf89019640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c0d92b0 0x7fdf7c038640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf78009790 tx=0x7fdf7802a1a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f9009375640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ff0004800 0x7f8ff0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f6650001670 con 0x7f6660155f70 2024-04-26T17:58:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df414c250 con 0x7f0df415a570 2024-04-26T17:58:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df4139dd0 con 0x7f0df415a570 2024-04-26T17:58:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f900a377640 1 -- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ff0004800 msgr2=0x7f8ff0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f900a377640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ff0004800 0x7f8ff0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f900a377640 1 -- 172.21.15.12:0/1994587956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff0003b80 msgr2=0x7f8ff0003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f900a377640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff0003b80 0x7f8ff0003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f900a377640 1 -- 172.21.15.12:0/1994587956 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff0010990 con 0x7f8ff00051c0 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f4032a19640 1 -- start start 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 >> v1:172.21.15.12:6789/0 conn(0x7f6660155f70 legacy=0x7f666015f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/456605238 shutdown_connections 2024-04-26T17:58:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.157+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/456605238 wait complete. 2024-04-26T17:58:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7f900a377640 1 -- 172.21.15.12:0/1994587956 reap_dead start 2024-04-26T17:58:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fac14ca7640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac100c3ea0 0x7fac101576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.158+0000 7fac0ffff640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac10073280 0x7fac100c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 -- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac10073280 msgr2=0x7fac100c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac10073280 0x7fac100c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 -- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac100c3ea0 msgr2=0x7fac101576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f664c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac100c3ea0 0x7fac101576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 -- 172.21.15.12:0/2056120343 shutdown_connections 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0378f0 0x7fdf7c038b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 --2- 172.21.15.12:0/2056120343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c0d92b0 0x7fdf7c038640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 -- 172.21.15.12:0/2056120343 >> 172.21.15.12:0/2056120343 conn(0x7fdf7c054600 msgr2=0x7fdf7c054a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c004800 0x7f664c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac10154860 con 0x7fac100c29c0 2024-04-26T17:58:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f1b8d6c2640 1 Processor -- start 2024-04-26T17:58:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c0052e0 0x7f664c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f8b9e8cf640 1 Processor -- start 2024-04-26T17:58:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0df40ca8b0 con 0x7f0df415a570 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665f7fe640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f664c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f402404f690 0x7f402400d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 0x7f402417cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40240e6f50 0x7f402404b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4024038f10 con 0x7f40240e6630 2024-04-26T17:58:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4024007a70 con 0x7f40240e6f50 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032a19640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f40240dd720 con 0x7f402404f690 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f6656ffd640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c004800 0x7f664c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4031216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 0x7f402417cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4031216640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 0x7f402417cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43046/0 (socket says 172.21.15.12:43046) 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4031216640 1 -- 172.21.15.12:0/3003148404 learned_addr learned my addr 172.21.15.12:0/3003148404 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40240e6f50 0x7f402404b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 -- 172.21.15.12:0/2056120343 shutdown_connections 2024-04-26T17:58:41.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fac0f7fe640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 0x7fac10158420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c950 tx=0x7fabf800ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7fdf89019640 1 -- 172.21.15.12:0/2056120343 wait complete. 2024-04-26T17:58:41.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f900a377640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 0x7f8ff000b9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007b60 tx=0x7f8ff0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4712bebf23432ae server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665ffff640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c0052e0 0x7f664c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66600cc1c0 con 0x7f664c0052e0 2024-04-26T17:58:41.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f664c00c0f0 con 0x7f664c004800 2024-04-26T17:58:41.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f664c00c2f0 con 0x7f664c0039b0 2024-04-26T17:58:41.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f8b9e8cf640 1 -- start start 2024-04-26T17:58:41.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f402404f690 msgr2=0x7f402400d980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:58:41.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f402404f690 0x7f402400d980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40240e6f50 msgr2=0x7f402404b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007ba0 con 0x7f8ff00051c0 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4037070 con 0x7f8ff00051c0 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f9008b74640 1 -- 172.21.15.12:0/1994587956 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005490 con 0x7f8ff00051c0 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40240e6f50 0x7f402404b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40240e6330 con 0x7f40240e6630 2024-04-26T17:58:41.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f4031216640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 0x7f402417cd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f402c06bef0 tx=0x7f402c06b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98068ad0 0x7f8b9815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b9806e630 0x7f8b980c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8015070 con 0x7fac100c29c0 2024-04-26T17:58:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98072460 0x7f8b980cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8b980c9170 con 0x7f8b98068ad0 2024-04-26T17:58:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf80078e0 con 0x7fac100c29c0 2024-04-26T17:58:41.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b980c8e90 con 0x7f8b98072460 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c0bc070 con 0x7f40240e6630 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c0afa10 con 0x7f40240e6630 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c0afdc0 con 0x7f40240e6630 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f402400dec0 con 0x7f40240e6630 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40240e5d70 con 0x7f40240e6630 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac10152b50 con 0x7fac100c29c0 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101530b0 con 0x7fac100c29c0 2024-04-26T17:58:41.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf8007cb0 con 0x7fac100c29c0 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7fdf89019640 1 Processor -- start 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7fdf89019640 1 -- start start 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.159+0000 7f1b8d6c2640 1 -- start start 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b80005810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 0x7f1b8016ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800dfff0 0x7f1b800e0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800dd830 con 0x7f1b800e6140 2024-04-26T17:58:41.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1b800072e0 con 0x7f1b780039b0 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f1b8d6c2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8004c700 con 0x7f1b800dfff0 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f1b877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 0x7f1b8016ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f1b877fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 0x7f1b8016ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43062/0 (socket says 172.21.15.12:43062) 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f1b877fe640 1 -- 172.21.15.12:0/374697101 learned_addr learned my addr 172.21.15.12:0/374697101 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f1b8cec1640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800dfff0 0x7f1b800e0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f665f7fe640 1 -- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c004800 msgr2=0x7f664c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f665f7fe640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c004800 0x7f664c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f665f7fe640 1 -- 172.21.15.12:0/4194315236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c0052e0 msgr2=0x7f664c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f665f7fe640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c0052e0 0x7f664c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f665f7fe640 1 -- 172.21.15.12:0/4194315236 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c003520 con 0x7f664c0039b0 2024-04-26T17:58:41.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f665ffff640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c0052e0 0x7f664c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f665ffff640 1 -- 172.21.15.12:0/4194315236 reap_dead start 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f6656ffd640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c004800 0x7f664c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.160+0000 7f8b9e8cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8b98152160 con 0x7f8b9806e630 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f8b977fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b9806e630 0x7f8b980c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f8b977fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b9806e630 0x7f8b980c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36770/0 (socket says 172.21.15.12:36770) 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f8b977fe640 1 -- 172.21.15.12:0/3627772292 learned_addr learned my addr 172.21.15.12:0/3627772292 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f900ab78640 1 -- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 msgr2=0x7f8ff000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f900ab78640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 0x7f8ff000b9c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4007b60 tx=0x7f8ff0005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f900ab78640 1 -- 172.21.15.12:0/1994587956 shutdown_connections 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f900ab78640 1 --2- 172.21.15.12:0/1994587956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ff00051c0 0x7f8ff000b9c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f900ab78640 1 -- 172.21.15.12:0/1994587956 >> 172.21.15.12:0/1994587956 conn(0x7f900406ed20 msgr2=0x7f900406f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f8b9ce6c640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98072460 0x7f8b980cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f8b97fff640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98068ad0 0x7f8b9815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac10156fc0 con 0x7fac100c29c0 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.161+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0df00037b0 con 0x7f0df415a570 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0de9ffb640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0dd806c8f0 0x7f0dd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0df008c190 con 0x7f0df415a570 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0df92d5640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0dd806c8f0 0x7f0dd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0de9ffb640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f0dd8076060 0x7f0dd80784a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0df0020e50 con 0x7f0dd8076060 2024-04-26T17:58:41.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0df008c580 con 0x7f0df415a570 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b9ce6c640 1 -- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b9806e630 msgr2=0x7f8b980c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b9ce6c640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b9806e630 0x7f8b980c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b9ce6c640 1 -- 172.21.15.12:0/3627772292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98068ad0 msgr2=0x7f8b9815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 -- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800dfff0 msgr2=0x7f1b800e0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1b800dfff0 0x7f1b800e0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 -- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 msgr2=0x7f1b80005810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1b780039b0 0x7f1b80005810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b800ddb50 con 0x7f1b800e6140 2024-04-26T17:58:41.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f1b877fe640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 0x7f1b8016ec10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b88076bd0 tx=0x7f1b8806a0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f665f7fe640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f664c003d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6650004f50 tx=0x7f664c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1896a2aa30c89fa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b9ce6c640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98068ad0 0x7f8b9815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b9ce6c640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9815be80 con 0x7f8b98072460 2024-04-26T17:58:41.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650004ba0 con 0x7f664c0039b0 2024-04-26T17:58:41.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7fdf89019640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 0x7fdf7c04bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf89019640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf7c0378f0 0x7fdf7c0ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665002f030 con 0x7f664c0039b0 2024-04-26T17:58:41.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f665effd640 1 -- 172.21.15.12:0/4194315236 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650005d50 con 0x7f664c0039b0 2024-04-26T17:58:41.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.162+0000 7f8b97fff640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b98068ad0 0x7f8b9815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:41.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f0df92d5640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0dd806c8f0 0x7f0dd806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009870 tx=0x7f0de402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f0df8ad4640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f0dd8076060 0x7f0dd80784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 0x7fdf7c04bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf89019640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0d92b0 0x7fdf7c0d9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 0x7fdf7c04bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:40546/0 (socket says 172.21.15.12:40546) 2024-04-26T17:58:41.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b9ce6c640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98072460 0x7f8b980cc500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e7f0 tx=0x7f8b8800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f900ab78640 1 -- 172.21.15.12:0/1994587956 shutdown_connections 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 -- 172.21.15.12:0/1568668919 learned_addr learned my addr 172.21.15.12:0/1568668919 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c0df4a0 con 0x7fdf7c0378f0 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf88818640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0d92b0 0x7fdf7c0d9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdf7c038120 con 0x7fdf7c037170 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88017070 con 0x7f8b98072460 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8800c940 con 0x7f8b98072460 2024-04-26T17:58:41.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800cd10 con 0x7f8b98072460 2024-04-26T17:58:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdf7c0df620 con 0x7fdf7c0d92b0 2024-04-26T17:58:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b980c3160 con 0x7f8b98072460 2024-04-26T17:58:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b98159110 con 0x7f8b98072460 2024-04-26T17:58:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f402417c930 con 0x7f40240e6630 2024-04-26T17:58:41.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf837fe640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf7c0378f0 0x7fdf7c0ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 -- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0d92b0 msgr2=0x7fdf7c0d9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdf7c0d92b0 0x7fdf7c0d9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 -- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf7c0378f0 msgr2=0x7fdf7c0ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7fdf83fff640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdf7c0378f0 0x7fdf7c0ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7fdf83fff640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf7c0d9780 con 0x7fdf7c037170 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 msgr2=0x7f664c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f6665e2a640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f664c003d90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6650004f50 tx=0x7f664c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.163+0000 7f0df8ad4640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f0dd8076060 0x7f0dd80784a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7fdf83fff640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 0x7fdf7c04bbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf780098b0 tx=0x7fdf780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b88074820 con 0x7f1b800e6140 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b88091070 con 0x7f1b800e6140 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b880749c0 con 0x7f1b800e6140 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b800dfb40 con 0x7f1b800e6140 2024-04-26T17:58:41.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b800dddc0 con 0x7f1b800e6140 2024-04-26T17:58:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabf8018070 con 0x7fac100c29c0 2024-04-26T17:58:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 shutdown_connections 2024-04-26T17:58:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f6665e2a640 1 --2- 172.21.15.12:0/4194315236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f664c003d90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 >> 172.21.15.12:0/4194315236 conn(0x7f6660074500 msgr2=0x7f6660068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== osd.2 v2:172.21.15.12:6810/1580244255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0df0020e50 con 0x7f0dd8076060 2024-04-26T17:58:41.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b9814c8c0 con 0x7f8b98072460 2024-04-26T17:58:41.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0cff9640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fabf006c9c0 0x7fabf006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fabf808c3d0 con 0x7fac100c29c0 2024-04-26T17:58:41.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0cff9640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7fabf0076130 0x7fabf0078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabf8007e50 con 0x7fabf0076130 2024-04-26T17:58:41.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fabf808c7c0 con 0x7fac100c29c0 2024-04-26T17:58:41.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.164+0000 7f900ab78640 1 -- 172.21.15.12:0/1994587956 wait complete. 2024-04-26T17:58:41.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7fac0ffff640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fabf006c9c0 0x7fabf006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f402c0b5040 con 0x7f40240e6630 2024-04-26T17:58:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b8801a070 con 0x7f8b98072460 2024-04-26T17:58:41.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 shutdown_connections 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7f40227fc640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f401006c9f0 0x7f401006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f402c12a770 con 0x7f40240e6630 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.165+0000 7f4031a17640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f401006c9f0 0x7f401006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f40227fc640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78037050 con 0x7fdf7c037170 2024-04-26T17:58:41.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf78044070 con 0x7fdf7c037170 2024-04-26T17:58:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf78030b10 con 0x7fdf7c037170 2024-04-26T17:58:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf7c179150 con 0x7fdf7c037170 2024-04-26T17:58:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f4031a17640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f401006c9f0 0x7f401006eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f401c000f60 tx=0x7f401c007a00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf7c0db3c0 con 0x7fdf7c037170 2024-04-26T17:58:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f402c070200 con 0x7f4010076170 2024-04-26T17:58:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f402c12ab60 con 0x7f40240e6630 2024-04-26T17:58:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b8406c9c0 0x7f8b8406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7fac14ca7640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7fabf0076130 0x7fabf0078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8b8808bd10 con 0x7f8b98072460 2024-04-26T17:58:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f8b84076130 0x7f8b84078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b84078c40 con 0x7f8b84076130 2024-04-26T17:58:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7fac0ffff640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fabf006c9c0 0x7fabf006ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac00008ee0 tx=0x7fac00008430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.166+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b8808e370 con 0x7f8b98072460 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f8b97fff640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b8406c9c0 0x7f8b8406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f900ab78640 1 Processor -- start 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f900ab78640 1 -- start start 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b8806f620 con 0x7f1b800e6140 2024-04-26T17:58:41.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b68001030 con 0x7f1b800e6140 2024-04-26T17:58:41.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f8b977fe640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f8b84076130 0x7f8b84078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f6665e2a640 1 -- 172.21.15.12:0/4194315236 wait complete. 2024-04-26T17:58:41.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.167+0000 7f1b84ff9640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b6c06c9f0 0x7f1b6c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1b881090c0 con 0x7f1b800e6140 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f1b84ff9640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f1b6c0760f0 0x7f1b6c078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b6c078c00 con 0x7f1b6c0760f0 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f900ab78640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 0x7f90040c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7fac14ca7640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7fabf0076130 0x7fabf0078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f8b97fff640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b8406c9c0 0x7f8b8406ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f60 tx=0x7f8b8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f1b8cec1640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f1b6c0760f0 0x7f1b6c078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf7c005380 con 0x7fdf7c037170 2024-04-26T17:58:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f900ab78640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415bf60 0x7f90040c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f9009b76640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 0x7f90040c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf78030cb0 con 0x7fdf7c037170 2024-04-26T17:58:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f8b977fe640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f8b84076130 0x7f8b84078570 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f900ab78640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f900414a4d0 0x7f900414a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.168+0000 7f1b87fff640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b6c06c9f0 0x7f1b6c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f9009b76640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 0x7f90040c6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43090/0 (socket says 172.21.15.12:43090) 2024-04-26T17:58:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== osd.0 v2:172.21.15.12:6800/1222565562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f402c070200 con 0x7f4010076170 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900ab78640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f90040ca6c0 con 0x7f8ff00051c0 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f900415d630 con 0x7f900415bf60 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f9009b76640 1 -- 172.21.15.12:0/3973865896 learned_addr learned my addr 172.21.15.12:0/3973865896 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f90040ca840 con 0x7f900414a4d0 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f900414a4d0 0x7f900414a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f1b8cec1640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f1b6c0760f0 0x7f1b6c078530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f1b8809b070 con 0x7f1b800e6140 2024-04-26T17:58:41.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f9009375640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415bf60 0x7f90040c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf80ff9640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdf6806c9f0 0x7fdf6806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdf780b45a0 con 0x7fdf7c037170 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf80ff9640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7fdf680760e0 0x7fdf68078520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf7800af30 con 0x7fdf680760e0 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdf780bb050 con 0x7fdf7c037170 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fdf837fe640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdf6806c9f0 0x7fdf6806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== osd.1 v2:172.21.15.12:6822/214863022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabf8007e50 con 0x7fabf0076130 2024-04-26T17:58:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f1b87fff640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b6c06c9f0 0x7f1b6c06eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400ba00 tx=0x7f1b74030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f6665e2a640 1 Processor -- start 2024-04-26T17:58:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== osd.7 v2:172.21.15.100:6816/2213109725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b84078c40 con 0x7f8b84076130 2024-04-26T17:58:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f6665e2a640 1 -- start start 2024-04-26T17:58:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== osd.4 v2:172.21.15.100:6800/2805574331 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b6c078c00 con 0x7f1b6c0760f0 2024-04-26T17:58:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 -- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415bf60 msgr2=0x7f90040c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f900415bf60 0x7f90040c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 -- 172.21.15.12:0/3973865896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 msgr2=0x7f90040c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 0x7f90040c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.169+0000 7f900a377640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90041ed9f0 con 0x7f900414a4d0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f900a377640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f900414a4d0 0x7f900414a980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90040c7db0 tx=0x7f900415d5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff404b070 con 0x7f900414a4d0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff40035f0 con 0x7f900414a4d0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4007ba0 con 0x7f900414a4d0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7fdf88818640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7fdf680760e0 0x7fdf68078520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.170+0000 7fdf837fe640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdf6806c9f0 0x7fdf6806eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf8402e060 tx=0x7fdf8406a5f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.171+0000 7fdf88818640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7fdf680760e0 0x7fdf68078520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.171+0000 7f9009b76640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ff00051c0 0x7f90040c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.171+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90040c4570 con 0x7f900414a4d0 2024-04-26T17:58:41.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.171+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90040c6c40 con 0x7f900414a4d0 2024-04-26T17:58:41.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== osd.3 v2:172.21.15.12:6808/3057566562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf7800af30 con 0x7fdf680760e0 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90040506c0 con 0x7f900414a4d0 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f6660157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66601f5820 0x7f6660158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6660158ad0 0x7f6660145e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f66600c6a80 con 0x7f6660158ad0 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f666015f4c0 con 0x7f66601f5820 2024-04-26T17:58:41.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f6665e2a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f66600ce5b0 con 0x7f664c0039b0 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f665f7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f6660157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f665f7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f6660157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36818/0 (socket says 172.21.15.12:36818) 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.172+0000 7f665f7fe640 1 -- 172.21.15.12:0/2139064608 learned_addr learned my addr 172.21.15.12:0/2139064608 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 -- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66601f5820 msgr2=0x7f6660158590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66601f5820 0x7f6660158590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 -- 172.21.15.12:0/2139064608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6660158ad0 msgr2=0x7f6660145e20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6660158ad0 0x7f6660145e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66601564b0 con 0x7f664c0039b0 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.173+0000 7f665f7fe640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f6660157e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6650005070 tx=0x7f665002d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ff4044070 con 0x7f900414a4d0 2024-04-26T17:58:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650039030 con 0x7f664c0039b0 2024-04-26T17:58:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6650001890 con 0x7f664c0039b0 2024-04-26T17:58:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650001670 con 0x7f664c0039b0 2024-04-26T17:58:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6660156790 con 0x7f664c0039b0 2024-04-26T17:58:41.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.174+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6660156d50 con 0x7f664c0039b0 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.175+0000 7f8ffa7fc640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8fe806c920 0x7f8fe806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.175+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ff40b3940 con 0x7f900414a4d0 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.175+0000 7f8ffa7fc640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f8fe80760a0 0x7f8fe80784e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.176+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8fe8078bb0 con 0x7f8fe80760a0 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.177+0000 7f9009375640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f8fe80760a0 0x7f8fe80784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.177+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8ff40b82a0 con 0x7f900414a4d0 2024-04-26T17:58:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.177+0000 7f9009b76640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8fe806c920 0x7f8fe806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.176+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6644001030 con 0x7f664c0039b0 2024-04-26T17:58:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.177+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66500080f0 con 0x7f664c0039b0 2024-04-26T17:58:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.177+0000 7f665cff9640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f664006c940 0x7f664006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f9009375640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f8fe80760a0 0x7f8fe80784e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66500bce40 con 0x7f664c0039b0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f665cff9640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f66400760c0 0x7f6640078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f6656ffd640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f664006c940 0x7f664006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6650050e50 con 0x7f66400760c0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f66500bf520 con 0x7f664c0039b0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.178+0000 7f665ffff640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f66400760c0 0x7f6640078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.179+0000 7f6656ffd640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f664006c940 0x7f664006ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66600c89e0 tx=0x7f6648009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.179+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== osd.5 v2:172.21.15.100:6802/4224810891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8fe8078bb0 con 0x7f8fe80760a0 2024-04-26T17:58:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.179+0000 7f9009b76640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8fe806c920 0x7f8fe806ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9000004f20 tx=0x7f9000009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.184+0000 7f665ffff640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f66400760c0 0x7f6640078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.185+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== osd.6 v2:172.21.15.100:6824/862079515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6650050e50 con 0x7f66400760c0 2024-04-26T17:58:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.195+0000 7fdf89019640 1 -- 172.21.15.12:0/1568668919 --> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdf7c039630 con 0x7fdf680760e0 2024-04-26T17:58:41.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.195+0000 7fdf80ff9640 1 -- 172.21.15.12:0/1568668919 <== osd.3 v2:172.21.15.12:6808/3057566562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdf7c039630 con 0x7fdf680760e0 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.196+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7fdf680760e0 msgr2=0x7fdf68078520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.196+0000 7fdf6e7fc640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7fdf680760e0 0x7fdf68078520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdf6806c9f0 msgr2=0x7fdf6806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdf6806c9f0 0x7fdf6806eeb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf8402e060 tx=0x7fdf8406a5f0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 msgr2=0x7fdf7c04bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 --2- 172.21.15.12:0/1568668919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf7c037170 0x7fdf7c04bbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf780098b0 tx=0x7fdf780046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf88818640 1 -- 172.21.15.12:0/1568668919 reap_dead start 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 shutdown_connections 2024-04-26T17:58:41.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 >> 172.21.15.12:0/1568668919 conn(0x7fdf7c054600 msgr2=0x7fdf7c0d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.197+0000 7f0dfb539640 1 -- 172.21.15.12:0/448856609 --> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0df4076d20 con 0x7f0dd8076060 2024-04-26T17:58:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.198+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 shutdown_connections 2024-04-26T17:58:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.198+0000 7fdf6e7fc640 1 -- 172.21.15.12:0/1568668919 wait complete. 2024-04-26T17:58:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.198+0000 7f0de9ffb640 1 -- 172.21.15.12:0/448856609 <== osd.2 v2:172.21.15.12:6810/1580244255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0df4076d20 con 0x7f0dd8076060 2024-04-26T17:58:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f0dd8076060 msgr2=0x7f0dd80784a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f0dd8076060 0x7f0dd80784a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0dd806c8f0 msgr2=0x7f0dd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0dd806c8f0 0x7f0dd806edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009870 tx=0x7f0de402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df415a570 msgr2=0x7f0df4133d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 --2- 172.21.15.12:0/448856609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0df415a570 0x7f0df4133d70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0df000c540 tx=0x7f0df000ca00 comp rx=0 tx=0).stop 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0df9ad6640 1 -- 172.21.15.12:0/448856609 reap_dead start 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 shutdown_connections 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.199+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 >> 172.21.15.12:0/448856609 conn(0x7f0df40686c0 msgr2=0x7f0df40c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.201+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 shutdown_connections 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.201+0000 7f0dd77fe640 1 -- 172.21.15.12:0/448856609 wait complete. 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.202+0000 7f8b9e8cf640 1 -- 172.21.15.12:0/3627772292 --> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b98073dc0 con 0x7f8b84076130 2024-04-26T17:58:41.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40240057e0 con 0x7f4010076170 2024-04-26T17:58:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f8b94ff9640 1 -- 172.21.15.12:0/3627772292 <== osd.7 v2:172.21.15.100:6816/2213109725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b98073dc0 con 0x7f8b84076130 2024-04-26T17:58:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f4032218640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 msgr2=0x7f40100785b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f4032218640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 msgr2=0x7f40100785b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 msgr2=0x7f40100785b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f40227fc640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f4010076170 0x7f40100785b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.203+0000 7f40227fc640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f401007a770 0x7f401007cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f402c070200 con 0x7f401007a770 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=25}) -- 0x7f401007d170 con 0x7f40240e6630 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f401007a770 0x7f401007cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 --> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fac100506c0 con 0x7fabf0076130 2024-04-26T17:58:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f8b84076130 msgr2=0x7f8b84078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f8b7e7fc640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f8b84076130 0x7f8b84078570 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.204+0000 7f4032218640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f401007a770 0x7f401007cb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7fac0cff9640 1 -- 172.21.15.12:0/478535437 <== osd.1 v2:172.21.15.12:6822/214863022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fac100506c0 con 0x7fabf0076130 2024-04-26T17:58:41.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b8406c9c0 msgr2=0x7f8b8406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b8406c9c0 0x7f8b8406ee80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c000f60 tx=0x7f8b8c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f40227fc640 1 -- 172.21.15.12:0/3003148404 <== osd.0 v2:172.21.15.12:6800/1222565562 1 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f402c070200 con 0x7f401007a770 2024-04-26T17:58:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 --> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b68002dd0 con 0x7f1b6c0760f0 2024-04-26T17:58:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98072460 msgr2=0x7f8b980cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 --2- 172.21.15.12:0/3627772292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b98072460 0x7f8b980cc500 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800e7f0 tx=0x7f8b8800ecb0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b9ce6c640 1 -- 172.21.15.12:0/3627772292 reap_dead start 2024-04-26T17:58:41.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 shutdown_connections 2024-04-26T17:58:41.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 >> 172.21.15.12:0/3627772292 conn(0x7f8b980686c0 msgr2=0x7f8b98150cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7fabf0076130 msgr2=0x7fabf0078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7fac154a8640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7fabf0076130 0x7fabf0078570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.254 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f1b84ff9640 1 -- 172.21.15.12:0/374697101 <== osd.4 v2:172.21.15.100:6800/2805574331 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b68002dd0 con 0x7f1b6c0760f0 2024-04-26T17:58:41.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 shutdown_connections 2024-04-26T17:58:41.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f8b7e7fc640 1 -- 172.21.15.12:0/3627772292 wait complete. 2024-04-26T17:58:41.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.205+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f401007a770 msgr2=0x7f401007cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.255 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7f401007a770 0x7f401007cb60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fabf006c9c0 msgr2=0x7fabf006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fabf006c9c0 0x7fabf006ee80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac00008ee0 tx=0x7fac00008430 comp rx=0 tx=0).stop 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 msgr2=0x7fac10158420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 --2- 172.21.15.12:0/478535437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac100c29c0 0x7fac10158420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fabf800c950 tx=0x7fabf800ce10 comp rx=0 tx=0).stop 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac14ca7640 1 -- 172.21.15.12:0/478535437 reap_dead start 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f401006c9f0 msgr2=0x7f401006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f401006c9f0 0x7f401006eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f401c000f60 tx=0x7f401c007a00 comp rx=0 tx=0).stop 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 msgr2=0x7f402417cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 --2- 172.21.15.12:0/3003148404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40240e6630 0x7f402417cd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f402c06bef0 tx=0x7f402c06b9a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.256 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032218640 1 -- 172.21.15.12:0/3003148404 reap_dead start 2024-04-26T17:58:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 shutdown_connections 2024-04-26T17:58:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 >> 172.21.15.12:0/478535437 conn(0x7fac100c9a90 msgr2=0x7fac100c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 shutdown_connections 2024-04-26T17:58:41.257 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 >> 172.21.15.12:0/3003148404 conn(0x7f4024054520 msgr2=0x7f40240d37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 shutdown_connections 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7fac154a8640 1 -- 172.21.15.12:0/478535437 wait complete. 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f1b6c0760f0 msgr2=0x7f1b6c078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.206+0000 7f1b8d6c2640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f1b6c0760f0 0x7f1b6c078530 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b6c06c9f0 msgr2=0x7f1b6c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1b6c06c9f0 0x7f1b6c06eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400ba00 tx=0x7f1b74030000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 msgr2=0x7f1b8016ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 --2- 172.21.15.12:0/374697101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b800e6140 0x7f1b8016ec10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1b88076bd0 tx=0x7f1b8806a0e0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8cec1640 1 -- 172.21.15.12:0/374697101 reap_dead start 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 shutdown_connections 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 >> 172.21.15.12:0/374697101 conn(0x7f1b80050180 msgr2=0x7f1b800d7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.207+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 shutdown_connections 2024-04-26T17:58:41.259 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.208+0000 7f4032a19640 1 -- 172.21.15.12:0/3003148404 wait complete. 2024-04-26T17:58:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.208+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 --> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90040c8150 con 0x7f8fe80760a0 2024-04-26T17:58:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.209+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 shutdown_connections 2024-04-26T17:58:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.209+0000 7f1b8d6c2640 1 -- 172.21.15.12:0/374697101 wait complete. 2024-04-26T17:58:41.260 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.209+0000 7f8ffa7fc640 1 -- 172.21.15.12:0/3973865896 <== osd.5 v2:172.21.15.100:6802/4224810891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90040c8150 con 0x7f8fe80760a0 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.210+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f8fe80760a0 msgr2=0x7f8fe80784e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.210+0000 7f900ab78640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f8fe80760a0 0x7f8fe80784e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8fe806c920 msgr2=0x7f8fe806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8fe806c920 0x7f8fe806ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9000004f20 tx=0x7f9000009040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f900414a4d0 msgr2=0x7f900414a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 --2- 172.21.15.12:0/3973865896 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f900414a4d0 0x7f900414a980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f90040c7db0 tx=0x7f900415d5a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900a377640 1 -- 172.21.15.12:0/3973865896 reap_dead start 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 shutdown_connections 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 >> 172.21.15.12:0/3973865896 conn(0x7f900406ed20 msgr2=0x7f90040739f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 shutdown_connections 2024-04-26T17:58:41.262 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.211+0000 7f900ab78640 1 -- 172.21.15.12:0/3973865896 wait complete. 2024-04-26T17:58:41.263 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.263 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.217+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 --> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6644002dd0 con 0x7f66400760c0 2024-04-26T17:58:41.264 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.219+0000 7f665cff9640 1 -- 172.21.15.12:0/2139064608 <== osd.6 v2:172.21.15.100:6824/862079515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6644002dd0 con 0x7f66400760c0 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f66400760c0 msgr2=0x7f6640078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f66400760c0 0x7f6640078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f664006c940 msgr2=0x7f664006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f664006c940 0x7f664006ee00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66600c89e0 tx=0x7f6648009040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 msgr2=0x7f6660157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 --2- 172.21.15.12:0/2139064608 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0039b0 0x7f6660157e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6650005070 tx=0x7f665002d070 comp rx=0 tx=0).stop 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f665ffff640 1 -- 172.21.15.12:0/2139064608 reap_dead start 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 shutdown_connections 2024-04-26T17:58:41.265 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.220+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 >> 172.21.15.12:0/2139064608 conn(0x7f6660074500 msgr2=0x7f66600b6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.221+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 shutdown_connections 2024-04-26T17:58:41.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.221+0000 7f6665e2a640 1 -- 172.21.15.12:0/2139064608 wait complete. 2024-04-26T17:58:41.266 INFO:teuthology.orchestra.run.smithi012.stdout:55834574860 2024-04-26T17:58:41.267 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T17:58:41.267 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.268 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T17:58:41.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T17:58:41.269 INFO:teuthology.orchestra.run.smithi012.stdout:55834574860 2024-04-26T17:58:41.270 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T17:58:41.270 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.271 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T17:58:41.271 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T17:58:41.272 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T17:58:41.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.481+0000 7f22ae2b7640 1 Processor -- start 2024-04-26T17:58:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.481+0000 7fac87809640 1 Processor -- start 2024-04-26T17:58:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7ff08d6a8640 1 Processor -- start 2024-04-26T17:58:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7ff08d6a8640 1 -- start start 2024-04-26T17:58:41.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7fac87809640 1 -- start start 2024-04-26T17:58:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7f22ae2b7640 1 -- start start 2024-04-26T17:58:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7ffab0fa7640 1 Processor -- start 2024-04-26T17:58:41.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.482+0000 7ffab0fa7640 1 -- start start 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7fac87809640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac800cb570 0x7fac800c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7fac87809640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8006fa50 con 0x7fac80153c90 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7fac87809640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8006fd30 con 0x7fac800c4370 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7fac87809640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fac8006e330 con 0x7fac800cb570 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f8a66338640 1 Processor -- start 2024-04-26T17:58:41.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f8a66338640 1 -- start start 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08d6a8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff088153be0 0x7ff08806fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08d6a8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880c5ff0 con 0x7ff088072300 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08d6a8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880cb010 con 0x7ff0880b1e20 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08d6a8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff08806e330 con 0x7ff088153be0 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08cea7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff088072300 0x7ff0881641e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60712/0 (socket says 172.21.15.12:60712) 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7ff08cea7640 1 -- 172.21.15.12:0/2051947527 learned_addr learned my addr 172.21.15.12:0/2051947527 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711498056 0 0) 0x7ff0880c5ff0 con 0x7ff088072300 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff070003520 con 0x7ff088072300 2024-04-26T17:58:41.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7f22ae2b7640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f22a0050ca0 0x7f22a00dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7f22ae2b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 0x7f22a0005e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7f22ae2b7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a00068b0 con 0x7f22a00063d0 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7f22ae2b7640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f22a0006b90 con 0x7f22a0050ca0 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.483+0000 7f22ae2b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f22a0006e70 con 0x7f22a00d4d90 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22acab4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 0x7f22a0005e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22acab4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 0x7f22a0005e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36824/0 (socket says 172.21.15.12:36824) 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22acab4640 1 -- 172.21.15.12:0/137839652 learned_addr learned my addr 172.21.15.12:0/137839652 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22adab6640 1 --1- 172.21.15.12:0/137839652 >> v1:172.21.15.12:6789/0 conn(0x7f22a00063d0 0x7f22a004b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60720/0 (socket says 172.21.15.12:60720) 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/137839652 >> v2:172.21.15.100:3300/0 conn(0x7f22a0050ca0 0x7f22a00dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f229ffff640 1 -- 172.21.15.12:0/137839652 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267600894 0 0) 0x7f22a00068b0 con 0x7f22a00063d0 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f184ce37640 1 Processor -- start 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f184ce37640 1 -- start start 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22ad2b5640 1 -- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 msgr2=0x7f22a0005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 0x7f22a0005e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22ad2b5640 1 -- 172.21.15.12:0/137839652 >> v1:172.21.15.12:6789/0 conn(0x7f22a00063d0 legacy=0x7f22a004b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7f22ad2b5640 1 -- 172.21.15.12:0/137839652 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a0007150 con 0x7f22a0050ca0 2024-04-26T17:58:41.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7ff087fff640 1 --2- 172.21.15.12:0/2051947527 >> v2:172.21.15.12:3300/0 conn(0x7ff088153be0 0x7ff08806fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1167620458 0 0) 0x7ff070003520 con 0x7ff088072300 2024-04-26T17:58:41.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 >> v2:172.21.15.12:3300/0 conn(0x7ff088153be0 msgr2=0x7ff08806fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac84da4640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac800c4370 0x7fac800cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44920/0 (socket says 172.21.15.12:44920) 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac84da4640 1 -- 172.21.15.12:0/351133846 learned_addr learned my addr 172.21.15.12:0/351133846 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac85da6640 1 --2- 172.21.15.12:0/351133846 >> v2:172.21.15.100:3300/0 conn(0x7fac800cb570 0x7fac800c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac77fff640 1 -- 172.21.15.12:0/351133846 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232643171 0 0) 0x7fac8006fd30 con 0x7fac800c4370 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac77fff640 1 -- 172.21.15.12:0/351133846 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac6c003520 con 0x7fac800c4370 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac85da6640 1 -- 172.21.15.12:0/351133846 >> v1:172.21.15.100:6789/0 conn(0x7fac800c4370 legacy=0x7fac800cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.484+0000 7fac85da6640 1 -- 172.21.15.12:0/351133846 >> v1:172.21.15.12:6789/0 conn(0x7fac80153c90 legacy=0x7fac8015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7fac85da6640 1 -- 172.21.15.12:0/351133846 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac80070010 con 0x7fac800cb570 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 --2- 172.21.15.12:0/2051947527 >> v2:172.21.15.12:3300/0 conn(0x7ff088153be0 0x7ff08806fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 >> v1:172.21.15.100:6789/0 conn(0x7ff0880b1e20 legacy=0x7ff088071bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0880c6290 con 0x7ff088072300 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7fdc8b59e640 1 Processor -- start 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f8a66338640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8a600c98e0 0x7f8a601585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f8a66338640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60072460 0x7f8a600c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f8a66338640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a60158af0 con 0x7f8a6006e0f0 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f8a648d5640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8a6006e0f0 0x7f8a6006e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60736/0 (socket says 172.21.15.12:60736) 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a648d5640 1 -- 172.21.15.12:0/2674839706 learned_addr learned my addr 172.21.15.12:0/2674839706 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7ff0800019f0 con 0x7ff088072300 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff087fff640 1 --2- 172.21.15.12:0/2051947527 >> v2:172.21.15.12:3300/0 conn(0x7ff088153be0 0x7ff08806fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 >> v1:172.21.15.12:6789/0 conn(0x7ff088072300 legacy=0x7ff0881641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0700039b0 0x7ff070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 0x7ff070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.490 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7ff086ffd640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0700052e0 0x7ff07000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff0877fe640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 0x7ff070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff08806e330 con 0x7ff0700039b0 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff07000c1b0 con 0x7ff070004800 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a0050ca0 0x7f22a00dac60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22a40097a0 tx=0x7f22a402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c26b236b061b55d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f229ffff640 1 -- 172.21.15.12:0/137839652 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4037070 con 0x7f22a0050ca0 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f229ffff640 1 -- 172.21.15.12:0/137839652 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a4032440 con 0x7f22a0050ca0 2024-04-26T17:58:41.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f2dc3fff640 1 Processor -- start 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f184ce37640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f184ce37640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 0x7f18480c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f184ce37640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1848158af0 con 0x7f184806e0f0 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f184ce37640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f18480c9450 con 0x7f1848072460 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f184ce37640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f18480c85f0 con 0x7f18480c98e0 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36834/0 (socket says 172.21.15.12:36834) 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 -- 172.21.15.12:0/1196974988 learned_addr learned my addr 172.21.15.12:0/1196974988 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f1845d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 0x7f18480c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7fdc8b59e640 1 -- start start 2024-04-26T17:58:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff08cea7640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0700052e0 0x7ff07000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff087fff640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0700039b0 0x7ff070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8a600c9450 con 0x7f8a600c98e0 2024-04-26T17:58:41.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600c85f0 con 0x7f8a60072460 2024-04-26T17:58:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff07000c3b0 con 0x7ff0700052e0 2024-04-26T17:58:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 -- 172.21.15.12:0/1196974988 >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 msgr2=0x7f18480c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7fac85da6640 1 --2- 172.21.15.12:0/351133846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800cb570 0x7fac800c4d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fac700097a0 tx=0x7fac7002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66718c71b7b46be server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7fac77fff640 1 -- 172.21.15.12:0/351133846 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70037070 con 0x7fac800cb570 2024-04-26T17:58:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7fac77fff640 1 -- 172.21.15.12:0/351133846 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7002ae10 con 0x7fac800cb570 2024-04-26T17:58:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7fac77fff640 1 -- 172.21.15.12:0/351133846 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70032660 con 0x7fac800cb570 2024-04-26T17:58:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fdc8b59e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc84050b20 0x7fdc840e24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fdc8b59e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc840df000 con 0x7fdc840d9310 2024-04-26T17:58:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fdc8b59e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc840df2e0 con 0x7fdc8400fae0 2024-04-26T17:58:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 -- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a0050ca0 msgr2=0x7f22a00dac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f229ffff640 1 -- 172.21.15.12:0/137839652 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4037070 con 0x7f22a0050ca0 2024-04-26T17:58:41.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.485+0000 7f2dc3fff640 1 -- start start 2024-04-26T17:58:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a0050ca0 0x7f22a00dac60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f22a40097a0 tx=0x7f22a402a230 comp rx=0 tx=0).stop 2024-04-26T17:58:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2dc40c30d0 0x7f2dc40736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc3fff640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc415b010 con 0x7f2dc40c3ea0 2024-04-26T17:58:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc3fff640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc40c93b0 con 0x7f2dc4073280 2024-04-26T17:58:41.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153678440 0 0) 0x7f8a58001490 con 0x7f8a6006e0f0 2024-04-26T17:58:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a48003520 con 0x7f8a6006e0f0 2024-04-26T17:58:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/2674839706 >> v2:172.21.15.100:3300/0 conn(0x7f8a600c98e0 0x7f8a601585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5f7fe640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60072460 0x7f8a600c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc3fff640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc40c8bd0 con 0x7f2dc40c30d0 2024-04-26T17:58:41.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2111800923 0 0) 0x7f8a48003520 con 0x7f8a6006e0f0 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60072460 msgr2=0x7f8a600c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60072460 0x7f8a600c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 >> v2:172.21.15.100:3300/0 conn(0x7f8a600c98e0 msgr2=0x7f8a601585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 --2- 172.21.15.12:0/2674839706 >> v2:172.21.15.100:3300/0 conn(0x7f8a600c98e0 0x7f8a601585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600c88d0 con 0x7f8a6006e0f0 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f8a58001bc0 con 0x7f8a6006e0f0 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 >> v1:172.21.15.12:6789/0 conn(0x7f8a6006e0f0 legacy=0x7f8a6006e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a480039b0 0x7f8a48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a48004800 0x7f8a48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a480051c0 0x7f8a4800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600c9450 con 0x7f8a480039b0 2024-04-26T17:58:41.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600c85f0 con 0x7f8a480051c0 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4800c0b0 con 0x7f8a48004800 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff0877fe640 1 -- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0700052e0 msgr2=0x7ff07000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff0877fe640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff0700052e0 0x7ff07000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff0877fe640 1 -- 172.21.15.12:0/2051947527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0700039b0 msgr2=0x7ff070003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff0877fe640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0700039b0 0x7ff070003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff0877fe640 1 -- 172.21.15.12:0/2051947527 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070003520 con 0x7ff070004800 2024-04-26T17:58:41.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a480039b0 0x7f8a48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ffab0fa7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 0x7ffaa404b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fdc8b59e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdc84050fa0 con 0x7fdc84050b20 2024-04-26T17:58:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 -- 172.21.15.12:0/137839652 shutdown_connections 2024-04-26T17:58:41.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a00d4d90 0x7f22a0005e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/137839652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a0050ca0 0x7f22a00dac60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 -- 172.21.15.12:0/137839652 >> 172.21.15.12:0/137839652 conn(0x7f22a0050180 msgr2=0x7f22a0050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc27fc640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2dc4073280 0x7f2dc40c29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44948/0 (socket says 172.21.15.12:44948) 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f2dc27fc640 1 -- 172.21.15.12:0/1137919502 learned_addr learned my addr 172.21.15.12:0/1137919502 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 --2- 172.21.15.12:0/1196974988 >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 0x7f18480c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 -- 172.21.15.12:0/1196974988 >> v1:172.21.15.100:6789/0 conn(0x7f184806e0f0 legacy=0x7f184806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f184659c640 1 -- 172.21.15.12:0/1196974988 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18480c88d0 con 0x7f18480c98e0 2024-04-26T17:58:41.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.486+0000 7f1845d9b640 1 --2- 172.21.15.12:0/1196974988 >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 0x7f18480c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ffaab7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffaa40d55d0 0x7ffaa4045ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60772/0 (socket says 172.21.15.12:60772) 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ffab0fa7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa4007690 con 0x7ffaa40d55d0 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffab0fa7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaa4007970 con 0x7ffaa40461c0 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffab0fa7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa40d59b0 con 0x7ffaa404cf40 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaab7fe640 1 -- 172.21.15.12:0/1438591966 learned_addr learned my addr 172.21.15.12:0/1438591966 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:41.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7f22ae2b7640 1 -- 172.21.15.12:0/137839652 shutdown_connections 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fac87809640 1 -- 172.21.15.12:0/351133846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800cb570 msgr2=0x7fac800c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7fac87809640 1 --2- 172.21.15.12:0/351133846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800cb570 0x7fac800c4d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fac700097a0 tx=0x7fac7002a100 comp rx=0 tx=0).stop 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fac87809640 1 -- 172.21.15.12:0/351133846 shutdown_connections 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fac87809640 1 --2- 172.21.15.12:0/351133846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800cb570 0x7fac800c4d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fdc8ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc84050b20 0x7fdc840e24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fdc8ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc84050b20 0x7fdc840e24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:40606/0 (socket says 172.21.15.12:40606) 2024-04-26T17:58:41.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fac87809640 1 -- 172.21.15.12:0/351133846 >> 172.21.15.12:0/351133846 conn(0x7fac80071d70 msgr2=0x7fac80072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fdc8ad9d640 1 -- 172.21.15.12:0/1936790878 learned_addr learned my addr 172.21.15.12:0/1936790878 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.487+0000 7ff08cea7640 1 -- 172.21.15.12:0/2051947527 reap_dead start 2024-04-26T17:58:41.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fac87809640 1 -- 172.21.15.12:0/351133846 shutdown_connections 2024-04-26T17:58:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaaaffd640 1 --2- 172.21.15.12:0/1438591966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 0x7ffaa404b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f184659c640 1 --2- 172.21.15.12:0/1196974988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c02a1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb7748bcdac05a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a5ffff640 1 -- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a48004800 msgr2=0x7f8a48004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a48004800 0x7f8a48004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a5ffff640 1 -- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a480051c0 msgr2=0x7f8a4800b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f2dc1ffb640 1 -- 172.21.15.12:0/1137919502 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129985366 0 0) 0x7f2dc40c93b0 con 0x7f2dc4073280 2024-04-26T17:58:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f2dc1ffb640 1 -- 172.21.15.12:0/1137919502 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dac003520 con 0x7f2dc4073280 2024-04-26T17:58:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7fac87809640 1 -- 172.21.15.12:0/351133846 wait complete. 2024-04-26T17:58:41.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a648d5640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a480051c0 0x7f8a4800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f184559a640 1 -- 172.21.15.12:0/1196974988 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c037070 con 0x7f18480c98e0 2024-04-26T17:58:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a480051c0 0x7f8a4800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaaa7fc640 1 -- 172.21.15.12:0/1438591966 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 327200759 0 0) 0x7ffaa4007690 con 0x7ffaa40d55d0 2024-04-26T17:58:41.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaaaffd640 1 -- 172.21.15.12:0/1438591966 >> v1:172.21.15.100:6789/0 conn(0x7ffaa40461c0 legacy=0x7ffaa40de7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaaaffd640 1 -- 172.21.15.12:0/1438591966 >> v1:172.21.15.12:6789/0 conn(0x7ffaa40d55d0 legacy=0x7ffaa4045ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f184559a640 1 -- 172.21.15.12:0/1196974988 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c032440 con 0x7f18480c98e0 2024-04-26T17:58:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f184559a640 1 -- 172.21.15.12:0/1196974988 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c032810 con 0x7f18480c98e0 2024-04-26T17:58:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f8a5ffff640 1 -- 172.21.15.12:0/2674839706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600c88d0 con 0x7f8a480039b0 2024-04-26T17:58:41.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/1137919502 >> v2:172.21.15.12:3300/0 conn(0x7f2dc40c30d0 0x7f2dc40736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7ffaaaffd640 1 -- 172.21.15.12:0/1438591966 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa4007c50 con 0x7ffaa404cf40 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.488+0000 7f22ae2b7640 1 -- 172.21.15.12:0/137839652 wait complete. 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f2dc1ffb640 1 -- 172.21.15.12:0/1137919502 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763088922 0 0) 0x7f2dc415b010 con 0x7f2dc40c3ea0 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f2dc37fe640 1 -- 172.21.15.12:0/1137919502 >> v1:172.21.15.100:6789/0 conn(0x7f2dc4073280 legacy=0x7f2dc40c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f2dc37fe640 1 -- 172.21.15.12:0/1137919502 >> v1:172.21.15.12:6789/0 conn(0x7f2dc40c3ea0 legacy=0x7f2dc40c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f2dc37fe640 1 -- 172.21.15.12:0/1137919502 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc40c9690 con 0x7f2dc40c30d0 2024-04-26T17:58:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517309242 0 0) 0x7fdc840df2e0 con 0x7fdc8400fae0 2024-04-26T17:58:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc74003520 con 0x7fdc8400fae0 2024-04-26T17:58:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7ff0877fe640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 0x7ff070004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0880d02a0 tx=0x7ff070005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140c12f0792ee13c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a480039b0 0x7f8a48003dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400dec0 tx=0x7f8a48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e797b301127700fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ffaaaffd640 1 --2- 172.21.15.12:0/1438591966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 0x7ffaa404b940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009750 tx=0x7ffaa002a010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa408d795f48c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f184ce37640 1 -- 172.21.15.12:0/1196974988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 msgr2=0x7f18481585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7f184ce37640 1 --2- 172.21.15.12:0/1196974988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f183c009870 tx=0x7f183c02a1d0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 874541476 0 0) 0x7fdc74003520 con 0x7fdc8400fae0 2024-04-26T17:58:41.512 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 >> v2:172.21.15.100:3300/0 conn(0x7fdc84050b20 msgr2=0x7fdc840e24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 --2- 172.21.15.12:0/1936790878 >> v2:172.21.15.100:3300/0 conn(0x7fdc84050b20 0x7fdc840e24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 >> v1:172.21.15.12:6789/0 conn(0x7fdc840d9310 legacy=0x7fdc8404f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840df5c0 con 0x7fdc8400fae0 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fdc8c0506c0 con 0x7fdc8400fae0 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 >> v1:172.21.15.100:6789/0 conn(0x7fdc8400fae0 legacy=0x7fdc84050410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc740039b0 0x7fdc74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 0x7fdc740048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc74005050 0x7fdc7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84050fa0 con 0x7fdc740043c0 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7400bfb0 con 0x7fdc740039b0 2024-04-26T17:58:41.513 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7400c1b0 con 0x7fdc74005050 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 -- 172.21.15.12:0/1196974988 shutdown_connections 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 --2- 172.21.15.12:0/1196974988 >> v2:172.21.15.12:3300/0 conn(0x7f1848072460 0x7f18480c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 --2- 172.21.15.12:0/1196974988 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f18480c98e0 0x7f18481585b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 -- 172.21.15.12:0/1196974988 >> 172.21.15.12:0/1196974988 conn(0x7f18480686c0 msgr2=0x7f184806fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fac87809640 1 Processor -- start 2024-04-26T17:58:41.514 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f8a648d5640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a480051c0 0x7f8a4800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fac87809640 1 -- start start 2024-04-26T17:58:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c037070 con 0x7ff070004800 2024-04-26T17:58:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.489+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c02ab20 con 0x7ff070004800 2024-04-26T17:58:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff086ffd640 1 -- 172.21.15.12:0/2051947527 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c001430 con 0x7ff070004800 2024-04-26T17:58:41.515 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ffaaa7fc640 1 -- 172.21.15.12:0/1438591966 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0037070 con 0x7ffaa404cf40 2024-04-26T17:58:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 0x7fdc740048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ffaaa7fc640 1 -- 172.21.15.12:0/1438591966 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa002ad20 con 0x7ffaa404cf40 2024-04-26T17:58:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f2dc37fe640 1 --2- 172.21.15.12:0/1137919502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc40c30d0 0x7f2dc40736e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097a0 tx=0x7f2db402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2262d93985bbddb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.516 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff08d6a8640 1 -- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 msgr2=0x7ff070004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 -- 172.21.15.12:0/1196974988 shutdown_connections 2024-04-26T17:58:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f184ce37640 1 -- 172.21.15.12:0/1196974988 wait complete. 2024-04-26T17:58:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 0x7ff070004c80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0880d02a0 tx=0x7ff070005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f2dc1ffb640 1 -- 172.21.15.12:0/1137919502 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2db4037070 con 0x7f2dc40c30d0 2024-04-26T17:58:41.517 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff08d6a8640 1 -- 172.21.15.12:0/2051947527 shutdown_connections 2024-04-26T17:58:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7f2dc1ffb640 1 -- 172.21.15.12:0/1137919502 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db4032640 con 0x7f2dc40c30d0 2024-04-26T17:58:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/2051947527 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff070004800 0x7ff070004c80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7ff08d6a8640 1 -- 172.21.15.12:0/2051947527 >> 172.21.15.12:0/2051947527 conn(0x7ff0880712b0 msgr2=0x7ff088073fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.518 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ff08d6a8640 1 -- 172.21.15.12:0/2051947527 shutdown_connections 2024-04-26T17:58:41.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7f22ae2b7640 1 Processor -- start 2024-04-26T17:58:41.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ff08d6a8640 1 -- 172.21.15.12:0/2051947527 wait complete. 2024-04-26T17:58:41.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc8ad9d640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc74005050 0x7fdc7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc8a59c640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc740039b0 0x7fdc74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.519 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 -- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc74005050 msgr2=0x7fdc7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc74005050 0x7fdc7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 -- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc740039b0 msgr2=0x7fdc74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc740039b0 0x7fdc74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc89d9b640 1 -- 172.21.15.12:0/1936790878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840df5c0 con 0x7fdc740043c0 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc8a59c640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc740039b0 0x7fdc74003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc8ad9d640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc74005050 0x7fdc7400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7fdc8ad9d640 1 -- 172.21.15.12:0/1936790878 reap_dead start 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ffab0fa7640 1 -- 172.21.15.12:0/1438591966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 msgr2=0x7ffaa404b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ffab0fa7640 1 --2- 172.21.15.12:0/1438591966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 0x7ffaa404b940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009750 tx=0x7ffaa002a010 comp rx=0 tx=0).stop 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ffab0fa7640 1 -- 172.21.15.12:0/1438591966 shutdown_connections 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ffab0fa7640 1 --2- 172.21.15.12:0/1438591966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa404cf40 0x7ffaa404b940 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009750 tx=0x7ffaa002a010 comp rx=0 tx=0).stop 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7ffab0fa7640 1 -- 172.21.15.12:0/1438591966 >> 172.21.15.12:0/1438591966 conn(0x7ffaa404d4b0 msgr2=0x7ffaa404d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 0x7fac800cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 0x7fac800cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800ce8f0 0x7fac801f9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fac800ccca0 con 0x7fac800c4370 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fac800705d0 con 0x7fac800ce8f0 2024-04-26T17:58:41.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac87809640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fac800c47c0 con 0x7fac80153c90 2024-04-26T17:58:41.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a480039b0 2024-04-26T17:58:41.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5402adb0 con 0x7f8a480039b0 2024-04-26T17:58:41.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 0x7fdc740048a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c051930 tx=0x7fdc74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42003cf8b34613a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac855a5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 0x7fac800cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac855a5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 0x7fac800cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43126/0 (socket says 172.21.15.12:43126) 2024-04-26T17:58:41.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fac855a5640 1 -- 172.21.15.12:0/2185154799 learned_addr learned my addr 172.21.15.12:0/2185154799 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7f2dc3fff640 1 -- 172.21.15.12:0/1137919502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc40c30d0 msgr2=0x7f2dc40736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 0x7fac800cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0b5070 con 0x7fdc740043c0 2024-04-26T17:58:41.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0a8ab0 con 0x7fdc740043c0 2024-04-26T17:58:41.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7fdc8959a640 1 -- 172.21.15.12:0/1936790878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c069210 con 0x7fdc740043c0 2024-04-26T17:58:41.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.490+0000 7f8a5effd640 1 -- 172.21.15.12:0/2674839706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a480039b0 2024-04-26T17:58:41.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac85da6640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800ce8f0 0x7fac801f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f184ce37640 1 Processor -- start 2024-04-26T17:58:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.491+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/1137919502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc40c30d0 0x7f2dc40736e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097a0 tx=0x7f2db402a2c0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a480039b0 msgr2=0x7f8a48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f2dc3fff640 1 -- 172.21.15.12:0/1137919502 shutdown_connections 2024-04-26T17:58:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/1137919502 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc40c30d0 0x7f2dc40736e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f2dc3fff640 1 -- 172.21.15.12:0/1137919502 >> 172.21.15.12:0/1137919502 conn(0x7f2dc40c9a90 msgr2=0x7f2dc40c9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f184ce37640 1 -- start start 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f22ae2b7640 1 -- start start 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 -- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800ce8f0 msgr2=0x7fac801f9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800ce8f0 0x7fac801f9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 -- 172.21.15.12:0/2185154799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 msgr2=0x7fac800cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 0x7fac800cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.526 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 -- 172.21.15.12:0/2185154799 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac800cc0c0 con 0x7fac80153c90 2024-04-26T17:58:41.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f2dc3fff640 1 -- 172.21.15.12:0/1137919502 shutdown_connections 2024-04-26T17:58:41.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7ffab0fa7640 1 -- 172.21.15.12:0/1438591966 shutdown_connections 2024-04-26T17:58:41.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7ffab0fa7640 1 -- 172.21.15.12:0/1438591966 wait complete. 2024-04-26T17:58:41.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7fac84da4640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 0x7fac800cdae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c3e0 tx=0x7fac7c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7ff08d6a8640 1 Processor -- start 2024-04-26T17:58:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fdc8b59e640 1 -- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 msgr2=0x7fdc740048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 0x7fdc740048a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c051930 tx=0x7fdc74005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f8a66338640 1 --2- 172.21.15.12:0/2674839706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a480039b0 0x7f8a48003dd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400dec0 tx=0x7f8a48005830 comp rx=0 tx=0).stop 2024-04-26T17:58:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7ff08d6a8640 1 -- start start 2024-04-26T17:58:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f184ce37640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f8a648d5640 1 -- 172.21.15.12:0/2674839706 reap_dead start 2024-04-26T17:58:41.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 shutdown_connections 2024-04-26T17:58:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 >> 172.21.15.12:0/2674839706 conn(0x7f8a600686c0 msgr2=0x7f8a6006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0074e0 con 0x7fac80153c90 2024-04-26T17:58:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c0047e0 con 0x7fac80153c90 2024-04-26T17:58:41.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac800cf880 con 0x7fac80153c90 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22a00063d0 0x7f22a00461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 0x7f22a00d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f22a004bd90 con 0x7f22a00063d0 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f22a004bc10 con 0x7f22a00d4d90 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22ae2b7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f22a0034a40 con 0x7f22a0050ca0 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fdc8b59e640 1 -- 172.21.15.12:0/1936790878 shutdown_connections 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/1936790878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc740043c0 0x7fdc740048a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fdc8b59e640 1 -- 172.21.15.12:0/1936790878 >> 172.21.15.12:0/1936790878 conn(0x7fdc84010ce0 msgr2=0x7fdc84006ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f184ce37640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 0x7f18480cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f184659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801580f0 con 0x7fac80153c90 2024-04-26T17:58:41.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f184659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36872/0 (socket says 172.21.15.12:36872) 2024-04-26T17:58:41.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22acab4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f184659c640 1 -- 172.21.15.12:0/4200317793 learned_addr learned my addr 172.21.15.12:0/4200317793 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22acab4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36888/0 (socket says 172.21.15.12:36888) 2024-04-26T17:58:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.493+0000 7f22acab4640 1 -- 172.21.15.12:0/176602067 learned_addr learned my addr 172.21.15.12:0/176602067 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f1845d9b640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 0x7f18480cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 0x7f18480cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22a00063d0 0x7f22a00461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ffab0fa7640 1 Processor -- start 2024-04-26T17:58:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22acab4640 1 -- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 msgr2=0x7f22a00d9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22adab6640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 0x7f22a00d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22acab4640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 0x7f22a00d9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22acab4640 1 -- 172.21.15.12:0/176602067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22a00063d0 msgr2=0x7f22a00461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22acab4640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22a00063d0 0x7f22a00461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22acab4640 1 -- 172.21.15.12:0/176602067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a00dd0f0 con 0x7f22a0050ca0 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f22adab6640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 0x7f22a00d9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f1846d9d640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 0x7f18480cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f18480c9170 con 0x7f18480c98e0 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f18480c8e90 con 0x7f1848072460 2024-04-26T17:58:41.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f18480ca200 con 0x7f184806e0f0 2024-04-26T17:58:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c004bf0 con 0x7fac80153c90 2024-04-26T17:58:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ff08d6a8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.492+0000 7f2dc3fff640 1 -- 172.21.15.12:0/1137919502 wait complete. 2024-04-26T17:58:41.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f2dc3fff640 1 Processor -- start 2024-04-26T17:58:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ff08d6a8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088157710 0x7ff08814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 shutdown_connections 2024-04-26T17:58:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f8a66338640 1 -- 172.21.15.12:0/2674839706 wait complete. 2024-04-26T17:58:41.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ff087fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ff087fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36902/0 (socket says 172.21.15.12:36902) 2024-04-26T17:58:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f22acab4640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f229800e8b0 tx=0x7f229800ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7ffab0fa7640 1 -- start start 2024-04-26T17:58:41.542 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 -- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 msgr2=0x7f184813cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 -- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 msgr2=0x7f18480cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 0x7f18480cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18481f6050 con 0x7f1848072460 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298017070 con 0x7f22a0050ca0 2024-04-26T17:58:41.543 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1846d9d640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 0x7f18480cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7ff087fff640 1 -- 172.21.15.12:0/1524892534 learned_addr learned my addr 172.21.15.12:0/1524892534 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1845d9b640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 0x7f18480cb790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f183800e930 tx=0x7f183800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.544 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7ff0877fe640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088157710 0x7ff08814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f184659c640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7ffab0fa7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa40461c0 0x7ffaa40db830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1838017070 con 0x7f1848072460 2024-04-26T17:58:41.545 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 0x7ff0881f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7ffab0fa7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183800ca00 con 0x7f1848072460 2024-04-26T17:58:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.494+0000 7f2dc3fff640 1 -- start start 2024-04-26T17:58:41.546 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18481f62f0 con 0x7f1848072460 2024-04-26T17:58:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac7c011070 con 0x7fac80153c90 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18480c6670 con 0x7f1848072460 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dc40c3ea0 0x7f2dc41feee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc415c950 0x7f2dc41558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc3fff640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc415b870 con 0x7f2dc415c950 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc3fff640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc415b590 con 0x7f2dc40c3ea0 2024-04-26T17:58:41.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc3fff640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc40c8fb0 con 0x7f2dc4073280 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ff08cea7640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 0x7ff0881f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaaaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43170/0 (socket says 172.21.15.12:43170) 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaaaffd640 1 -- 172.21.15.12:0/3098785311 learned_addr learned my addr 172.21.15.12:0/3098785311 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffab0fa7640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaa40332a0 0x7ffaa40d8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa404bf60 con 0x7ffaa40d55d0 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa404c390 con 0x7ffaa40332a0 2024-04-26T17:58:41.549 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa40082a0 con 0x7ffaa40461c0 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff088153fc0 con 0x7ff08814e630 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff0880c4740 con 0x7ff088157710 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff0880cacd0 con 0x7ff070004800 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f8a66338640 1 Processor -- start 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f8a66338640 1 -- start start 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a60142840 0x7f8a60144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36928/0 (socket says 172.21.15.12:36928) 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a5ffff640 1 -- 172.21.15.12:0/3351232874 learned_addr learned my addr 172.21.15.12:0/3351232874 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a600ccb80 0x7f8a60141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600c9170 con 0x7f8a60142840 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600c8e90 con 0x7f8a600ccb80 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8a60152160 con 0x7f8a60150a00 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f8a648d5640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a600ccb80 0x7f8a60141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 -- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088157710 msgr2=0x7ff08814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088157710 0x7ff08814e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 -- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 msgr2=0x7ff0881f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 0x7ff0881f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088157b70 con 0x7ff070004800 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff08cea7640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 0x7ff0881f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ff087fff640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff07800e8a0 tx=0x7ff07800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaabfff640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaa40332a0 0x7ffaa40d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a00dd390 con 0x7f22a0050ca0 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.495+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a00de940 con 0x7f22a0050ca0 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229800c940 con 0x7f22a0050ca0 2024-04-26T17:58:41.552 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229800cd10 con 0x7f22a0050ca0 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f229801a070 con 0x7f22a0050ca0 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f229dffb640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 0x7f228c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f229808bf80 con 0x7f22a0050ca0 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc2ffd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36906/0 (socket says 172.21.15.12:36906) 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/777920039 learned_addr learned my addr 172.21.15.12:0/777920039 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dc40c3ea0 0x7f2dc41feee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dc40c3ea0 msgr2=0x7f2dc41feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dc40c3ea0 0x7f2dc41feee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/777920039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc415c950 msgr2=0x7f2dc41558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc415c950 0x7f2dc41558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 -- 172.21.15.12:0/777920039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc4159b50 con 0x7f2dc4073280 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f2dc2ffd640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c7b0 tx=0x7f2dbc00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc003da0 con 0x7f2dc4073280 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dbc005070 con 0x7f2dc4073280 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800cdd0 con 0x7f1848072460 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f183801a070 con 0x7f1848072460 2024-04-26T17:58:41.554 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7fac75ffb640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 0x7fac6406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fac7c08b860 con 0x7fac80153c90 2024-04-26T17:58:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7fdc8b59e640 1 -- 172.21.15.12:0/1936790878 shutdown_connections 2024-04-26T17:58:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7fdc8b59e640 1 -- 172.21.15.12:0/1936790878 wait complete. 2024-04-26T17:58:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2288005290 con 0x7f22a0050ca0 2024-04-26T17:58:41.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dbc005420 con 0x7f2dc4073280 2024-04-26T17:58:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 0x7f228c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff078019020 con 0x7ff070004800 2024-04-26T17:58:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07800ee90 con 0x7ff070004800 2024-04-26T17:58:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07800ab40 con 0x7ff070004800 2024-04-26T17:58:41.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0881516e0 con 0x7ff070004800 2024-04-26T17:58:41.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184814fbc0 con 0x7f1848072460 2024-04-26T17:58:41.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7fac855a5640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 0x7fac6406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaab7fe640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa40461c0 0x7ffaa40db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaaaffd640 1 -- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa40461c0 msgr2=0x7ffaa40db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.496+0000 7ffaaaffd640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa40461c0 0x7ffaa40db830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ffaaaffd640 1 -- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaa40332a0 msgr2=0x7ffaa40d8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ffaaaffd640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaa40332a0 0x7ffaa40d8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ffaaaffd640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa40d9f70 con 0x7ffaa40d55d0 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.497+0000 7ffaaaffd640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa002a600 tx=0x7ffaa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0037050 con 0x7ffaa40d55d0 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.498+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa0043070 con 0x7ffaa40d55d0 2024-04-26T17:58:41.558 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f1836ffd640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 0x7f182806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff088151400 con 0x7ff070004800 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 -- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a600ccb80 msgr2=0x7f8a60141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a600ccb80 0x7f8a60141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 -- 172.21.15.12:0/3351232874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a60142840 msgr2=0x7f8a60144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a60142840 0x7f8a60144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.559 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6015a3e0 con 0x7f8a60150a00 2024-04-26T17:58:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f183808b9c0 con 0x7f1848072460 2024-04-26T17:58:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f8a5ffff640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a5402a8a0 tx=0x7f8a54004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0030df0 con 0x7ffaa40d55d0 2024-04-26T17:58:41.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.499+0000 7f184659c640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 0x7f182806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7fdc8b59e640 1 Processor -- start 2024-04-26T17:58:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa40d9160 con 0x7ffaa40d55d0 2024-04-26T17:58:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7fac855a5640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 0x7fac6406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac7800e250 tx=0x7fac7800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa40d7000 con 0x7ffaa40d55d0 2024-04-26T17:58:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac60005290 con 0x7fac80153c90 2024-04-26T17:58:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7fdc8b59e640 1 -- start start 2024-04-26T17:58:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc4158ab0 con 0x7f2dc4073280 2024-04-26T17:58:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc4159070 con 0x7f2dc4073280 2024-04-26T17:58:41.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7f22ad2b5640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 0x7f228c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22a4034000 tx=0x7f22a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7f184659c640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 0x7f182806ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f183c009630 tx=0x7f183c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.500+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0880506c0 con 0x7ff070004800 2024-04-26T17:58:41.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc840cec30 0x7fdc841788c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840e1220 0x7fdc840e16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84050590 con 0x7fdc840cec30 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84050410 con 0x7fdc840e1220 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8b59e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdc84050710 con 0x7fdc8404c5b0 2024-04-26T17:58:41.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa40057e0 con 0x7ffaa40d55d0 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36944/0 (socket says 172.21.15.12:36944) 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 -- 172.21.15.12:0/228393559 learned_addr learned my addr 172.21.15.12:0/228393559 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8ad9d640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840e1220 0x7fdc840e16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc8a59c640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc840cec30 0x7fdc841788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc40c7680 con 0x7f2dc4073280 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 -- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840e1220 msgr2=0x7fdc840e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840e1220 0x7fdc840e16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 -- 172.21.15.12:0/228393559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc840cec30 msgr2=0x7fdc841788c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc840cec30 0x7fdc841788c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 -- 172.21.15.12:0/228393559 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc840ddf80 con 0x7fdc8404c5b0 2024-04-26T17:58:41.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.501+0000 7fdc89d9b640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c065980 tx=0x7fdc8c064130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.502+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffaa0048460 con 0x7ffaa40d55d0 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.502+0000 7ffa97fff640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 0x7ffa9006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.502+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffaa00ac970 con 0x7ffaa40d55d0 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.502+0000 7ffaab7fe640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 0x7ffa9006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.503+0000 7ffaab7fe640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 0x7ffa9006ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa98000f60 tx=0x7ffa98007d00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.505+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2298059f80 con 0x7f22a0050ca0 2024-04-26T17:58:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.505+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f184814fbc0 con 0x7f1848072460 2024-04-26T17:58:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.505+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0c0020 con 0x7fdc8404c5b0 2024-04-26T17:58:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.505+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc84178f00 con 0x7fdc8404c5b0 2024-04-26T17:58:41.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.505+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc841794c0 con 0x7fdc8404c5b0 2024-04-26T17:58:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54042020 con 0x7f8a60150a00 2024-04-26T17:58:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a60145510 con 0x7f8a60150a00 2024-04-26T17:58:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff07801c020 con 0x7ff070004800 2024-04-26T17:58:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6015a960 con 0x7f8a60150a00 2024-04-26T17:58:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7ff084ff9640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 0x7ff07406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.506+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc840064d0 con 0x7fdc8404c5b0 2024-04-26T17:58:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7ff0877fe640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 0x7ff07406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2dbc0055c0 con 0x7f2dc4073280 2024-04-26T17:58:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffaa00aee20 con 0x7ffaa40d55d0 2024-04-26T17:58:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7ff0877fe640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 0x7ff07406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff07c034000 tx=0x7ff07c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7f2dab7fe640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 0x7f2db006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.507+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a60076d20 con 0x7f8a60150a00 2024-04-26T17:58:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.508+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 0x7f2db006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.508+0000 7f2dc27fc640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 0x7f2db006ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005fd0 tx=0x7f2db8005b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.510+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5402adb0 con 0x7f8a60150a00 2024-04-26T17:58:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.510+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54037070 con 0x7f8a60150a00 2024-04-26T17:58:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.510+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2dbc058280 con 0x7f2dc4073280 2024-04-26T17:58:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.510+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff0780586a0 con 0x7ff070004800 2024-04-26T17:58:41.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.510+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac7c059370 con 0x7fac80153c90 2024-04-26T17:58:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.512+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c0a8ab0 con 0x7fdc8404c5b0 2024-04-26T17:58:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.512+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c0b5040 con 0x7fdc8404c5b0 2024-04-26T17:58:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.515+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff078023020 con 0x7ff070004800 2024-04-26T17:58:41.574 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.520+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2dc40c7680 con 0x7f2dc4073280 2024-04-26T17:58:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.521+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a54045020 con 0x7f8a60150a00 2024-04-26T17:58:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.521+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdc8c0c3020 con 0x7fdc8404c5b0 2024-04-26T17:58:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.521+0000 7f8a5cff9640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 0x7f8a4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.521+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a540ac870 con 0x7f8a60150a00 2024-04-26T17:58:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.522+0000 7fdc7affd640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 0x7fdc6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.522+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdc8c12a670 con 0x7fdc8404c5b0 2024-04-26T17:58:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.522+0000 7fdc8a59c640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 0x7fdc6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.522+0000 7f8a5f7fe640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 0x7f8a4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.523+0000 7fdc8a59c640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 0x7fdc6c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc8404ba30 tx=0x7fdc7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.523+0000 7f8a5f7fe640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 0x7f8a4c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a60158750 tx=0x7f8a50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.524+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8a5404c070 con 0x7f8a60150a00 2024-04-26T17:58:41.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.530+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdc8c0ca030 con 0x7fdc8404c5b0 2024-04-26T17:58:41.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.922+0000 7ffab0fa7640 1 -- 172.21.15.12:0/3098785311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffaa404c510 con 0x7ffaa40d55d0 2024-04-26T17:58:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.923+0000 7ffa97fff640 1 -- 172.21.15.12:0/3098785311 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffaa40d9f70 con 0x7ffaa40d55d0 2024-04-26T17:58:41.922 INFO:teuthology.orchestra.run.smithi012.stdout:55834574857 2024-04-26T17:58:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.926+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 msgr2=0x7ffa9006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.926+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 0x7ffa9006ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa98000f60 tx=0x7ffa98007d00 comp rx=0 tx=0).stop 2024-04-26T17:58:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.926+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 msgr2=0x7ffaa40d7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.925 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.926+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ffaa002a600 tx=0x7ffaa00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 shutdown_connections 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffaa40332a0 0x7ffaa40d8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffaa40d55d0 0x7ffaa40d7ae0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ffa9006c940 0x7ffa9006ee00 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa98000f60 tx=0x7ffa98007d00 comp rx=0 tx=0).stop 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 --2- 172.21.15.12:0/3098785311 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffaa40461c0 0x7ffaa40db830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 >> 172.21.15.12:0/3098785311 conn(0x7ffaa404d4b0 msgr2=0x7ffaa40059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.927+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 shutdown_connections 2024-04-26T17:58:41.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.928+0000 7ffa95ffb640 1 -- 172.21.15.12:0/3098785311 wait complete. 2024-04-26T17:58:41.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-26T17:58:41.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.944+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fac60005580 con 0x7fac80153c90 2024-04-26T17:58:41.944 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.945+0000 7fac75ffb640 1 -- 172.21.15.12:0/2185154799 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac7c05d670 con 0x7fac80153c90 2024-04-26T17:58:41.945 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.948+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 msgr2=0x7fac6406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.948+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 0x7fac6406ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fac7800e250 tx=0x7fac7800b040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.948+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 msgr2=0x7fac800cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.948+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 0x7fac800cdae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00c3e0 tx=0x7fac7c00c8a0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 shutdown_connections 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac800ce8f0 0x7fac801f9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fac6406c9c0 0x7fac6406ee80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1848076d20 con 0x7f1848072460 2024-04-26T17:58:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fac80153c90 0x7fac800cdae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 --2- 172.21.15.12:0/2185154799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fac800c4370 0x7fac800cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 >> 172.21.15.12:0/2185154799 conn(0x7fac80071d70 msgr2=0x7fac80158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 shutdown_connections 2024-04-26T17:58:41.952 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7fac87809640 1 -- 172.21.15.12:0/2185154799 wait complete. 2024-04-26T17:58:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.949+0000 7f1836ffd640 1 -- 172.21.15.12:0/4200317793 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1838059470 con 0x7f1848072460 2024-04-26T17:58:41.953 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.952+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8a60072990 con 0x7f8a60150a00 2024-04-26T17:58:41.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.952+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2288005580 con 0x7f22a0050ca0 2024-04-26T17:58:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.952+0000 7f8a5cff9640 1 -- 172.21.15.12:0/3351232874 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a5407a9d0 con 0x7f8a60150a00 2024-04-26T17:58:41.954 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.952+0000 7f229dffb640 1 -- 172.21.15.12:0/176602067 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2298059880 con 0x7f22a0050ca0 2024-04-26T17:58:41.955 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 msgr2=0x7f182806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 0x7f182806ee80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f183c009630 tx=0x7f183c02e000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 msgr2=0x7f18480cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 0x7f18480cb790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f183800e930 tx=0x7f183800edf0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 shutdown_connections 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18480c98e0 0x7f18480cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1848072460 0x7f18480cb790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f182806c9c0 0x7f182806ee80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 --2- 172.21.15.12:0/4200317793 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f184806e0f0 0x7f184813cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 >> 172.21.15.12:0/4200317793 conn(0x7f18480686c0 msgr2=0x7f184814ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 shutdown_connections 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.953+0000 7f184ce37640 1 -- 172.21.15.12:0/4200317793 wait complete. 2024-04-26T17:58:41.956 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff08814dc60 con 0x7ff070004800 2024-04-26T17:58:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 msgr2=0x7f8a4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 0x7f8a4c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8a60158750 tx=0x7f8a50008040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 msgr2=0x7f228c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 0x7f228c06edb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f22a4034000 tx=0x7f22a402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:41.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 msgr2=0x7f8a601443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a5402a8a0 tx=0x7f8a54004730 comp rx=0 tx=0).stop 2024-04-26T17:58:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 msgr2=0x7f22a00d6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f229800e8b0 tx=0x7f229800ed70 comp rx=0 tx=0).stop 2024-04-26T17:58:41.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 shutdown_connections 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 shutdown_connections 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22a00d4d90 0x7f22a00d9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f228c06c8f0 0x7f228c06edb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22a0050ca0 0x7f22a00d6940 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f22ae2b7640 1 --2- 172.21.15.12:0/176602067 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f22a00063d0 0x7f22a00461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 >> 172.21.15.12:0/176602067 conn(0x7f22a0050180 msgr2=0x7f22a004efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.955+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a600ccb80 0x7f8a60141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a60142840 0x7f8a60144910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8a4c06c8f0 0x7f8a4c06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 --2- 172.21.15.12:0/3351232874 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a60150a00 0x7f8a601443d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 >> 172.21.15.12:0/3351232874 conn(0x7f8a600686c0 msgr2=0x7f8a600cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 shutdown_connections 2024-04-26T17:58:41.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f22ae2b7640 1 -- 172.21.15.12:0/176602067 wait complete. 2024-04-26T17:58:41.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7ff084ff9640 1 -- 172.21.15.12:0/1524892534 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff07805a600 con 0x7ff070004800 2024-04-26T17:58:41.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 shutdown_connections 2024-04-26T17:58:41.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f8a66338640 1 -- 172.21.15.12:0/3351232874 wait complete. 2024-04-26T17:58:41.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2dc40c93b0 con 0x7f2dc4073280 2024-04-26T17:58:41.961 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.956+0000 7f2dab7fe640 1 -- 172.21.15.12:0/777920039 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2dc40c93b0 con 0x7f2dc4073280 2024-04-26T17:58:41.962 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:41.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 msgr2=0x7ff07406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 0x7ff07406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff07c034000 tx=0x7ff07c009030 comp rx=0 tx=0).stop 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 msgr2=0x7ff0881530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff07800e8a0 tx=0x7ff07800ed60 comp rx=0 tx=0).stop 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 msgr2=0x7f2db006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 0x7f2db006ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005fd0 tx=0x7f2db8005b10 comp rx=0 tx=0).stop 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 msgr2=0x7f2dc4159e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc00c7b0 tx=0x7f2dbc00cc70 comp rx=0 tx=0).stop 2024-04-26T17:58:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 shutdown_connections 2024-04-26T17:58:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff08814e630 0x7ff0881f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff088157710 0x7ff08814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff07406c940 0x7ff07406ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 --2- 172.21.15.12:0/1524892534 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff070004800 0x7ff0881530b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 shutdown_connections 2024-04-26T17:58:41.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dc415c950 0x7f2dc41558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 >> 172.21.15.12:0/1524892534 conn(0x7ff0880712b0 msgr2=0x7ff08806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2dc40c3ea0 0x7f2dc41feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2db006c940 0x7f2db006ee00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 --2- 172.21.15.12:0/777920039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2dc4073280 0x7f2dc4159e60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 >> 172.21.15.12:0/777920039 conn(0x7f2dc40c9a90 msgr2=0x7f2dc40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 shutdown_connections 2024-04-26T17:58:41.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 shutdown_connections 2024-04-26T17:58:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.960+0000 7f2dc3fff640 1 -- 172.21.15.12:0/777920039 wait complete. 2024-04-26T17:58:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.961+0000 7ff08d6a8640 1 -- 172.21.15.12:0/1524892534 wait complete. 2024-04-26T17:58:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.966+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fdc840d7e80 con 0x7fdc8404c5b0 2024-04-26T17:58:41.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.967+0000 7fdc7affd640 1 -- 172.21.15.12:0/228393559 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc8c0f82a0 con 0x7fdc8404c5b0 2024-04-26T17:58:41.968 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:41.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.0 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 msgr2=0x7fdc6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 0x7fdc6c06edb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc8404ba30 tx=0x7fdc7c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 msgr2=0x7fdc840de740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c065980 tx=0x7fdc8c064130 comp rx=0 tx=0).stop 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 shutdown_connections 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840e1220 0x7fdc840e16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fdc6c06c8f0 0x7fdc6c06edb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdc8404c5b0 0x7fdc840de740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 --2- 172.21.15.12:0/228393559 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdc840cec30 0x7fdc841788c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 >> 172.21.15.12:0/228393559 conn(0x7fdc84010ce0 msgr2=0x7fdc840066e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 shutdown_connections 2024-04-26T17:58:41.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:41.971+0000 7fdc8b59e640 1 -- 172.21.15.12:0/228393559 wait complete. 2024-04-26T17:58:41.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-26T17:58:41.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2024-04-26T17:58:41.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2024-04-26T17:58:41.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2024-04-26T17:58:41.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-04-26T17:58:41.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-04-26T17:58:42.945 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-26T17:58:42.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T17:58:42.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-26T17:58:42.976 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T17:58:42.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T17:58:42.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-26T17:58:42.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-26T17:58:42.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.116+0000 7feeeb59e640 1 Processor -- start 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.116+0000 7feeeb59e640 1 -- start start 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.117+0000 7feeeb59e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feee40f6d50 0x7feee40fc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.117+0000 7feeeb59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feee4045670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.117+0000 7feeeb59e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee4045bb0 con 0x7feee4005e90 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.117+0000 7feeeb59e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7feee40f7130 con 0x7feee40f6d50 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.117+0000 7feeeb59e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feee40075a0 con 0x7feee4045220 2024-04-26T17:58:43.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.118+0000 7feeead9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feee4045670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.118+0000 7feeead9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feee4045670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48250/0 (socket says 172.21.15.12:48250) 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.118+0000 7feeead9d640 1 -- 172.21.15.12:0/4241923800 learned_addr learned my addr 172.21.15.12:0/4241923800 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.118+0000 7feeea59c640 1 --2- 172.21.15.12:0/4241923800 >> v2:172.21.15.12:3300/0 conn(0x7feee40f6d50 0x7feee40fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.119+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564936374 0 0) 0x7feee4045bb0 con 0x7feee4005e90 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.119+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feed4003420 con 0x7feee4005e90 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.119+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.1 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4019968885 0 0) 0x7feed4003420 con 0x7feee4005e90 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.119+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 msgr2=0x7feee4045670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.119+0000 7feee959a640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feee4045670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 >> v2:172.21.15.12:3300/0 conn(0x7feee40f6d50 msgr2=0x7feee40fc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 --2- 172.21.15.12:0/4241923800 >> v2:172.21.15.12:3300/0 conn(0x7feee40f6d50 0x7feee40fc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40066b0 con 0x7feee4005e90 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.1 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7feedc001670 con 0x7feee4005e90 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 >> v1:172.21.15.100:6789/0 conn(0x7feee4005e90 legacy=0x7feee404b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feed4004a90 0x7feed4004eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40036a0 0x7feed4003b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feed401c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feee40f7130 con 0x7feed4004a90 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feee40075a0 con 0x7feed40036a0 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feed4004500 con 0x7feee4045220 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feeea59c640 1 --2- 172.21.15.12:0/4241923800 >> v2:172.21.15.12:3300/0 conn(0x7feee40f6d50 0x7feee40fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.120+0000 7feee9d9b640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40036a0 0x7feed4003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feed401c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeea59c640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feed4004a90 0x7feed4004eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 -- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40036a0 msgr2=0x7feed4003b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feed40036a0 0x7feed4003b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 -- 172.21.15.12:0/4241923800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feed4004a90 msgr2=0x7feed4004eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feed4004a90 0x7feed4004eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.121+0000 7feeead9d640 1 -- 172.21.15.12:0/4241923800 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40066b0 con 0x7feee4045220 2024-04-26T17:58:43.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.122+0000 7feeea59c640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feed4004a90 0x7feed4004eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.123+0000 7feeead9d640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feed401c770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feeec06b420 tx=0x7feed4004720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f82bba201d801d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.123+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0c6070 con 0x7feee4045220 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.123+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeec0c1410 con 0x7feee4045220 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.123+0000 7feee959a640 1 -- 172.21.15.12:0/4241923800 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec0515b0 con 0x7feee4045220 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 -- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 msgr2=0x7feed401c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 --2- 172.21.15.12:0/4241923800 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee4045220 0x7feed401c770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feeec06b420 tx=0x7feed4004720 comp rx=0 tx=0).stop 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeead9d640 1 -- 172.21.15.12:0/4241923800 reap_dead start 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 -- 172.21.15.12:0/4241923800 shutdown_connections 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 -- 172.21.15.12:0/4241923800 >> 172.21.15.12:0/4241923800 conn(0x7feee4050180 msgr2=0x7feee4050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 -- 172.21.15.12:0/4241923800 shutdown_connections 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.124+0000 7feeeb59e640 1 -- 172.21.15.12:0/4241923800 wait complete. 2024-04-26T17:58:43.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.126+0000 7feeeb59e640 1 Processor -- start 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.127+0000 7feeeb59e640 1 -- start start 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee41884f0 0x7feee40f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 0x7feee40ecb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7feee4006f50 con 0x7feee4047b70 2024-04-26T17:58:43.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7feee4006c70 con 0x7feee41884f0 2024-04-26T17:58:43.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeeb59e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7feee4007230 con 0x7feee41888d0 2024-04-26T17:58:43.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feeea59c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee41884f0 0x7feee40f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feee9d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feee9d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48260/0 (socket says 172.21.15.12:48260) 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.128+0000 7feee9d9b640 1 -- 172.21.15.12:0/674570023 learned_addr learned my addr 172.21.15.12:0/674570023 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 -- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee41884f0 msgr2=0x7feee40f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee41884f0 0x7feee40f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 -- 172.21.15.12:0/674570023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 msgr2=0x7feee40ecb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feeead9d640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 0x7feee40ecb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 0x7feee40ecb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 -- 172.21.15.12:0/674570023 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee40480c0 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feeead9d640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 0x7feee40ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.129+0000 7feee9d9b640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feedc00fb90 tx=0x7feedc00d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.131+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc00fe90 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.131+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feedc018070 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.131+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee41962c0 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.131+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feee4196880 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.135+0000 7feed8ff9640 1 -- 172.21.15.12:0/674570023 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc005290 con 0x7feee41888d0 2024-04-26T17:58:43.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.135+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feedc00ddf0 con 0x7feee41888d0 2024-04-26T17:58:43.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.135+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feedc0050d0 con 0x7feee41888d0 2024-04-26T17:58:43.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.136+0000 7feedaffd640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 0x7feed4070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.136+0000 7feeea59c640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 0x7feed4070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.137+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feedc08c060 con 0x7feee41888d0 2024-04-26T17:58:43.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.137+0000 7feeea59c640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 0x7feed4070520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feee0009810 tx=0x7feee0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.140+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feedc05a130 con 0x7feee41888d0 2024-04-26T17:58:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.170+0000 7fb344112640 1 Processor -- start 2024-04-26T17:58:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.170+0000 7fb344112640 1 -- start start 2024-04-26T17:58:43.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7f3513245640 1 Processor -- start 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb344112640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3340fc9b0 0x7fb3340f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb344112640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb334045250 0x7fb3340456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb344112640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb334045be0 con 0x7fb334005ec0 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb344112640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb3340075d0 con 0x7fb334045250 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb344112640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340066e0 con 0x7fb3340fc9b0 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7fb341eae640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3340fc9b0 0x7fb3340f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7fb3416ad640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb334005ec0 0x7fb33404b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56480/0 (socket says 172.21.15.12:56480) 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7fb3416ad640 1 -- 172.21.15.12:0/1511827532 learned_addr learned my addr 172.21.15.12:0/1511827532 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7fb3426af640 1 --2- 172.21.15.12:0/1511827532 >> v2:172.21.15.12:3300/0 conn(0x7fb334045250 0x7fb3340456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f1e2f45b640 1 Processor -- start 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.172+0000 7f3513245640 1 -- start start 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f3513245640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3504045300 0x7f3504045700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f3513245640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3504006a70 con 0x7f35040dd480 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f3513245640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3504006d50 con 0x7f35040e67a0 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f3513245640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3504007680 con 0x7f3504045300 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f3510fe1640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35040dd480 0x7f350404b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56490/0 (socket says 172.21.15.12:56490) 2024-04-26T17:58:43.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f3510fe1640 1 -- 172.21.15.12:0/3293596561 learned_addr learned my addr 172.21.15.12:0/3293596561 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f4e64cda640 1 Processor -- start 2024-04-26T17:58:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7fb3426af640 1 -- 172.21.15.12:0/1511827532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3340fc9b0 msgr2=0x7fb3340f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7fb3426af640 1 --2- 172.21.15.12:0/1511827532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3340fc9b0 0x7fb3340f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7fb3426af640 1 -- 172.21.15.12:0/1511827532 >> v1:172.21.15.12:6789/0 conn(0x7fb334005ec0 legacy=0x7fb33404b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7fb3426af640 1 -- 172.21.15.12:0/1511827532 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3340069c0 con 0x7fb334045250 2024-04-26T17:58:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618394089 0 0) 0x7f3504006a70 con 0x7f35040dd480 2024-04-26T17:58:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34fc003520 con 0x7f35040dd480 2024-04-26T17:58:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f4e64cda640 1 -- start start 2024-04-26T17:58:43.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.173+0000 7f1e2f45b640 1 -- start start 2024-04-26T17:58:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1270428874 0 0) 0x7f34fc003520 con 0x7f35040dd480 2024-04-26T17:58:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3504045300 msgr2=0x7f3504045700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.174+0000 7f350b7fe640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3504045300 0x7f3504045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 >> v1:172.21.15.100:6789/0 conn(0x7f35040e67a0 legacy=0x7f35040e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f0ad9564640 1 Processor -- start 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2f45b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e200dac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2f45b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e20005e90 0x7f1e200062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2f45b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e20007710 con 0x7f1e2004b500 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2f45b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f1e200068b0 con 0x7f1e20005e90 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2f45b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1e20006b90 con 0x7f1e20050ca0 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2d9f8640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1e2004b500 0x7f1e20034a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56494/0 (socket says 172.21.15.12:56494) 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2d9f8640 1 -- 172.21.15.12:0/3603673943 learned_addr learned my addr 172.21.15.12:0/3603673943 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3504007030 con 0x7f35040dd480 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f3500001670 con 0x7f35040dd480 2024-04-26T17:58:43.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 >> v1:172.21.15.12:6789/0 conn(0x7f35040dd480 legacy=0x7f350404b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc0039e0 0x7f34fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34fc004800 0x7f34fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34fc005210 0x7f34fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3504007680 con 0x7f34fc004800 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc00c0c0 con 0x7f34fc0039e0 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc00c2c0 con 0x7f34fc005210 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f0ad9564640 1 -- start start 2024-04-26T17:58:43.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f1e2c9f6640 1 --2- 172.21.15.12:0/3603673943 >> v2:172.21.15.12:3300/0 conn(0x7f1e20005e90 0x7f1e200062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.175+0000 7f3510fe1640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc0039e0 0x7f34fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34fc004800 0x7f34fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e2d1f7640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e200dac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369686318 0 0) 0x7f1e20007710 con 0x7f1e2004b500 2024-04-26T17:58:43.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e14003520 con 0x7f1e2004b500 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f4e64cda640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e600ce310 0x7f4e600c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f35117e2640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34fc005210 0x7f34fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 -- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34fc005210 msgr2=0x7f34fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34fc005210 0x7f34fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 -- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc0039e0 msgr2=0x7f34fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc0039e0 0x7f34fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f4e5e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e600ce310 0x7f4e600c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f350bfff640 1 -- 172.21.15.12:0/3293596561 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3504007030 con 0x7f34fc004800 2024-04-26T17:58:43.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f77cbb7f640 1 Processor -- start 2024-04-26T17:58:43.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f77cbb7f640 1 -- start start 2024-04-26T17:58:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f4e5e59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e600ce310 0x7f4e600c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46750/0 (socket says 172.21.15.12:46750) 2024-04-26T17:58:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f3510fe1640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34fc0039e0 0x7f34fc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f0ad9564640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0acc04b090 0x7f0acc04b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 274432237 0 0) 0x7f1e14003520 con 0x7f1e2004b500 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 msgr2=0x7f1e200dac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e200dac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 >> v2:172.21.15.12:3300/0 conn(0x7f1e20005e90 msgr2=0x7f1e200062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 --2- 172.21.15.12:0/3603673943 >> v2:172.21.15.12:3300/0 conn(0x7f1e20005e90 0x7f1e200062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e20006e70 con 0x7f1e2004b500 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f1e280769f0 con 0x7f1e2004b500 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 >> v1:172.21.15.12:6789/0 conn(0x7f1e2004b500 legacy=0x7f1e20034a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e140039b0 0x7f1e14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004350 0x7f1e14004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f1e1ffff640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e14004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d1f7640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e140039b0 0x7f1e14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e200068b0 con 0x7f1e140039b0 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20006b90 con 0x7f1e14004350 2024-04-26T17:58:43.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1e140141d0 con 0x7f1e20050ca0 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f0ad9564640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc045330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f0ad37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0acc04b090 0x7f0acc04b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f0ad37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0acc04b090 0x7f0acc04b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46758/0 (socket says 172.21.15.12:46758) 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad37fe640 1 -- 172.21.15.12:0/3187223825 learned_addr learned my addr 172.21.15.12:0/3187223825 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad8d63640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc045330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0acc045ed0 con 0x7f0acc0d5200 2024-04-26T17:58:43.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.176+0000 7f0ad3fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0acc0d5200 0x7f0acc0db830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:53356/0 (socket says 172.21.15.12:53356) 2024-04-26T17:58:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7fb3426af640 1 --2- 172.21.15.12:0/1511827532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334045250 0x7fb3340456a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097a0 tx=0x7fb33802a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3636833b10e9daf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e14004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2c9f6640 1 --2- 172.21.15.12:0/3603673943 >> v2:172.21.15.12:3300/0 conn(0x7f1e20005e90 0x7f1e200062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0acc046f30 con 0x7f0acc04b090 2024-04-26T17:58:43.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0acc046170 con 0x7f0acc005e90 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 -- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004350 msgr2=0x7f1e14004820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e14004350 0x7f1e14004820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 -- 172.21.15.12:0/3603673943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e140039b0 msgr2=0x7f1e14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e140039b0 0x7f1e14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f1e2d9f8640 1 -- 172.21.15.12:0/3603673943 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e14003520 con 0x7f1e20050ca0 2024-04-26T17:58:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e64cda640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e6015c870 0x7f4e60152540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e64cda640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e600c9d40 con 0x7f4e600ce6f0 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e64cda640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4e600c8d60 con 0x7f4e600ce310 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e64cda640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4e600c7c90 con 0x7f4e6015c870 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e57fff640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4e600ce6f0 0x7f4e6015c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:53372/0 (socket says 172.21.15.12:53372) 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f4e57fff640 1 -- 172.21.15.12:0/2417100567 learned_addr learned my addr 172.21.15.12:0/2417100567 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad2ffd640 1 -- 172.21.15.12:0/3187223825 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2169819988 0 0) 0x7f0acc045ed0 con 0x7f0acc0d5200 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad2ffd640 1 -- 172.21.15.12:0/3187223825 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac4003520 con 0x7f0acc0d5200 2024-04-26T17:58:43.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7fb340eac640 1 -- 172.21.15.12:0/1511827532 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338037070 con 0x7fb334045250 2024-04-26T17:58:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7fb340eac640 1 -- 172.21.15.12:0/1511827532 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33802ad30 con 0x7fb334045250 2024-04-26T17:58:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7fb340eac640 1 -- 172.21.15.12:0/1511827532 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb338032660 con 0x7fb334045250 2024-04-26T17:58:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5ed9d640 1 --2- 172.21.15.12:0/2417100567 >> v2:172.21.15.100:3300/0 conn(0x7f4e6015c870 0x7f4e60152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5dd9b640 1 -- 172.21.15.12:0/2417100567 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582845041 0 0) 0x7f4e600c9d40 con 0x7f4e600ce6f0 2024-04-26T17:58:43.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f1e2d9f8640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e14004fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1e2806b660 tx=0x7f1e14005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80c3fedd843bcb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f350bfff640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34fc004800 0x7f34fc004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35040085b0 tx=0x7f34fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd1ddf5173f2bc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8037070 con 0x7f34fc004800 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f802a990 con 0x7f34fc004800 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f350b7fe640 1 -- 172.21.15.12:0/3293596561 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f80093d0 con 0x7f34fc004800 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77cbb7f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c41520f0 0x7f77c4157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77c911a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c41520f0 0x7f77c4157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77c911a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77c41520f0 0x7f77c4157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:41498/0 (socket says 172.21.15.12:41498) 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77c911a640 1 -- 172.21.15.12:0/3407167054 learned_addr learned my addr 172.21.15.12:0/3407167054 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c415b3c0 con 0x7f77c40ca1a0 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c415b660 con 0x7f77c40ca580 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f77c415b190 con 0x7f77c41520f0 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad37fe640 1 -- 172.21.15.12:0/3187223825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 msgr2=0x7f0acc045330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad37fe640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc045330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad37fe640 1 -- 172.21.15.12:0/3187223825 >> v1:172.21.15.100:6789/0 conn(0x7f0acc0d5200 legacy=0x7f0acc0db830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.177+0000 7f0ad37fe640 1 -- 172.21.15.12:0/3187223825 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc046450 con 0x7f0acc04b090 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f0ad37fe640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc04b620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80091e0 tx=0x7f0ac802c600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba78d8473d9de7a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 -- 172.21.15.12:0/1511827532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334045250 msgr2=0x7fb3340456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 --2- 172.21.15.12:0/1511827532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334045250 0x7fb3340456a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb3380097a0 tx=0x7fb33802a0a0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 -- 172.21.15.12:0/1511827532 shutdown_connections 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 --2- 172.21.15.12:0/1511827532 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb334045250 0x7fb3340456a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 --2- 172.21.15.12:0/1511827532 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb3340fc9b0 0x7fb3340f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 -- 172.21.15.12:0/1511827532 >> 172.21.15.12:0/1511827532 conn(0x7fb3340501b0 msgr2=0x7fb3340505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f0ad2ffd640 1 -- 172.21.15.12:0/3187223825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8038070 con 0x7f0acc04b090 2024-04-26T17:58:43.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5dd9b640 1 -- 172.21.15.12:0/2417100567 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e4c003520 con 0x7f4e600ce6f0 2024-04-26T17:58:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f0ad2ffd640 1 -- 172.21.15.12:0/3187223825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ac8031710 con 0x7f0acc04b090 2024-04-26T17:58:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f0ad2ffd640 1 -- 172.21.15.12:0/3187223825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8031ae0 con 0x7f0acc04b090 2024-04-26T17:58:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e280b5070 con 0x7f1e20050ca0 2024-04-26T17:58:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e280a8ad0 con 0x7f1e20050ca0 2024-04-26T17:58:43.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77c8919640 1 -- 172.21.15.12:0/3407167054 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532670922 0 0) 0x7f77c415b660 con 0x7f77c40ca580 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77c8919640 1 -- 172.21.15.12:0/3407167054 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77b0003520 con 0x7f77c40ca580 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77c911a640 1 -- 172.21.15.12:0/3407167054 >> v1:172.21.15.100:6789/0 conn(0x7f77c40ca580 legacy=0x7f77c40c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77c911a640 1 -- 172.21.15.12:0/3407167054 >> v1:172.21.15.12:6789/0 conn(0x7f77c40ca1a0 legacy=0x7f77c41519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f77c911a640 1 -- 172.21.15.12:0/3407167054 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c415b900 con 0x7f77c41520f0 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f1e1ffff640 1 -- 172.21.15.12:0/3603673943 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28050740 con 0x7f1e20050ca0 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f3513245640 1 -- 172.21.15.12:0/3293596561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34fc004800 msgr2=0x7f34fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7f3513245640 1 --2- 172.21.15.12:0/3293596561 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34fc004800 0x7f34fc004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35040085b0 tx=0x7f34fc005830 comp rx=0 tx=0).stop 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 -- 172.21.15.12:0/1511827532 shutdown_connections 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5e59c640 1 -- 172.21.15.12:0/2417100567 >> v2:172.21.15.100:3300/0 conn(0x7f4e6015c870 msgr2=0x7f4e60152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5e59c640 1 --2- 172.21.15.12:0/2417100567 >> v2:172.21.15.100:3300/0 conn(0x7f4e6015c870 0x7f4e60152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5e59c640 1 -- 172.21.15.12:0/2417100567 >> v1:172.21.15.100:6789/0 conn(0x7f4e600ce6f0 legacy=0x7f4e6015c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.178+0000 7f4e5e59c640 1 -- 172.21.15.12:0/2417100567 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e600c9fe0 con 0x7f4e600ce310 2024-04-26T17:58:43.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.179+0000 7fb344112640 1 -- 172.21.15.12:0/1511827532 wait complete. 2024-04-26T17:58:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f4e5e59c640 1 --2- 172.21.15.12:0/2417100567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e600ce310 0x7f4e600c71c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e600c6b30 tx=0x7f4e5002e680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b7a6be416c13af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 msgr2=0x7f0acc04b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7fa0bb511640 1 Processor -- start 2024-04-26T17:58:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc04b620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0ac80091e0 tx=0x7f0ac802c600 comp rx=0 tx=0).stop 2024-04-26T17:58:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f4e5dd9b640 1 -- 172.21.15.12:0/2417100567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5003a070 con 0x7f4e600ce310 2024-04-26T17:58:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f1e2f45b640 1 -- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 msgr2=0x7f1e14004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/3603673943 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e20050ca0 0x7f1e14004fa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1e2806b660 tx=0x7f1e14005830 comp rx=0 tx=0).stop 2024-04-26T17:58:43.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f1e2d9f8640 1 -- 172.21.15.12:0/3603673943 reap_dead start 2024-04-26T17:58:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f4e5dd9b640 1 -- 172.21.15.12:0/2417100567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e50033710 con 0x7f4e600ce310 2024-04-26T17:58:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 shutdown_connections 2024-04-26T17:58:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc04b620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 --2- 172.21.15.12:0/3187223825 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc045330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 >> 172.21.15.12:0/3187223825 conn(0x7f0acc050180 msgr2=0x7f0acc050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f4e5dd9b640 1 -- 172.21.15.12:0/2417100567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50033b20 con 0x7f4e600ce310 2024-04-26T17:58:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7fa0bb511640 1 -- start start 2024-04-26T17:58:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f1e2f45b640 1 -- 172.21.15.12:0/3603673943 shutdown_connections 2024-04-26T17:58:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f1e2f45b640 1 -- 172.21.15.12:0/3603673943 >> 172.21.15.12:0/3603673943 conn(0x7f1e20050180 msgr2=0x7f1e20050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 shutdown_connections 2024-04-26T17:58:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f35117e2640 1 -- 172.21.15.12:0/3293596561 reap_dead start 2024-04-26T17:58:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f0ad9564640 1 -- 172.21.15.12:0/3187223825 wait complete. 2024-04-26T17:58:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.180+0000 7f3513245640 1 -- 172.21.15.12:0/3293596561 shutdown_connections 2024-04-26T17:58:43.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f3513245640 1 -- 172.21.15.12:0/3293596561 >> 172.21.15.12:0/3293596561 conn(0x7f35040501b0 msgr2=0x7f35040505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7fb344112640 1 Processor -- start 2024-04-26T17:58:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f1e2f45b640 1 -- 172.21.15.12:0/3603673943 shutdown_connections 2024-04-26T17:58:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f1e2f45b640 1 -- 172.21.15.12:0/3603673943 wait complete. 2024-04-26T17:58:43.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7fb344112640 1 -- start start 2024-04-26T17:58:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f3513245640 1 -- 172.21.15.12:0/3293596561 shutdown_connections 2024-04-26T17:58:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f4e64cda640 1 -- 172.21.15.12:0/2417100567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e600ce310 msgr2=0x7f4e600c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.204 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f4e64cda640 1 --2- 172.21.15.12:0/2417100567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e600ce310 0x7f4e600c71c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e600c6b30 tx=0x7f4e5002e680 comp rx=0 tx=0).stop 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7fb344112640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 0x7fb3340f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb344112640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 0x7fb334048210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb344112640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 0x7fb33404f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb344112640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb334007260 con 0x7fb3340fc9b0 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb344112640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb334006f80 con 0x7fb334045250 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb344112640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb3340062e0 con 0x7fb334005ec0 2024-04-26T17:58:43.205 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb341eae640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 0x7fb3340f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb3416ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 0x7fb334048210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb3416ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 0x7fb334048210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:41508/0 (socket says 172.21.15.12:41508) 2024-04-26T17:58:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb3416ad640 1 -- 172.21.15.12:0/4003185877 learned_addr learned my addr 172.21.15.12:0/4003185877 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0bb511640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 0x7fa0b40c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.206 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb3426af640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 0x7fb33404f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0b92ad640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa0b4152330 0x7fa0b4157f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56504/0 (socket says 172.21.15.12:56504) 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0bb511640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0b40ca070 0x7fa0b40ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f77c911a640 1 --2- 172.21.15.12:0/3407167054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c4157ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00c2e0 tx=0x7f77bc02cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2641435df4573db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f4e64cda640 1 -- 172.21.15.12:0/2417100567 shutdown_connections 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f4e64cda640 1 --2- 172.21.15.12:0/2417100567 >> v2:172.21.15.100:3300/0 conn(0x7f4e6015c870 0x7f4e60152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.207 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f4e64cda640 1 --2- 172.21.15.12:0/2417100567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e600ce310 0x7f4e600c71c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f4e64cda640 1 -- 172.21.15.12:0/2417100567 >> 172.21.15.12:0/2417100567 conn(0x7f4e60073710 msgr2=0x7f4e60070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0b8aac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 0x7fa0b40c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f77c8919640 1 -- 172.21.15.12:0/3407167054 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc02dad0 con 0x7f77c41520f0 2024-04-26T17:58:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0b9aae640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0b40ca070 0x7fa0b40ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.208 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0b9aae640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa0b40ca070 0x7fa0b40ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:41524/0 (socket says 172.21.15.12:41524) 2024-04-26T17:58:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f77c8919640 1 -- 172.21.15.12:0/3407167054 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc02dc70 con 0x7f77c41520f0 2024-04-26T17:58:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7f77c8919640 1 -- 172.21.15.12:0/3407167054 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00a2f0 con 0x7f77c41520f0 2024-04-26T17:58:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0b8aac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 0x7fa0b40c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48316/0 (socket says 172.21.15.12:48316) 2024-04-26T17:58:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fa0bb511640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b4158630 con 0x7fa0b4152330 2024-04-26T17:58:43.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb341eae640 1 -- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 msgr2=0x7fb334048210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb341eae640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 0x7fb334048210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.182+0000 7fb341eae640 1 -- 172.21.15.12:0/4003185877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 msgr2=0x7fb33404f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f0ad9564640 1 Processor -- start 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.181+0000 7f3513245640 1 -- 172.21.15.12:0/3293596561 wait complete. 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fa0b4152710 con 0x7fa0b40ca070 2024-04-26T17:58:43.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b415bdc0 con 0x7fa0b40c8980 2024-04-26T17:58:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0b92ad640 1 -- 172.21.15.12:0/2725410277 learned_addr learned my addr 172.21.15.12:0/2725410277 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f1e2f45b640 1 Processor -- start 2024-04-26T17:58:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fb341eae640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 0x7fb33404f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fb341eae640 1 -- 172.21.15.12:0/4003185877 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3340f9980 con 0x7fb334005ec0 2024-04-26T17:58:43.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f1e2f45b640 1 -- start start 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fb341eae640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 0x7fb3340f4eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c610 tx=0x7fb32c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fb3426af640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 0x7fb33404f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f3513245640 1 Processor -- start 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0b9aae640 1 -- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 msgr2=0x7fa0b40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0b9aae640 1 --2- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 0x7fa0b40c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0b9aae640 1 -- 172.21.15.12:0/2725410277 >> v1:172.21.15.12:6789/0 conn(0x7fa0b4152330 legacy=0x7fa0b4157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7fa0b9aae640 1 -- 172.21.15.12:0/2725410277 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b40c99b0 con 0x7fa0b40ca070 2024-04-26T17:58:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f0ad9564640 1 -- start start 2024-04-26T17:58:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 msgr2=0x7f77c4157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/3407167054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c4157ff0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00c2e0 tx=0x7f77bc02cd80 comp rx=0 tx=0).stop 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.183+0000 7f3513245640 1 -- start start 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 shutdown_connections 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/3407167054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c4157ff0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 >> 172.21.15.12:0/3407167054 conn(0x7f77c4076820 msgr2=0x7f77c40680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f4e64cda640 1 -- 172.21.15.12:0/2417100567 shutdown_connections 2024-04-26T17:58:43.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f4e64cda640 1 -- 172.21.15.12:0/2417100567 wait complete. 2024-04-26T17:58:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 shutdown_connections 2024-04-26T17:58:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e20050ca0 0x7f1e201746e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c015070 con 0x7fb334005ec0 2024-04-26T17:58:43.215 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c004220 con 0x7fb334005ec0 2024-04-26T17:58:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb32c003610 con 0x7fb334005ec0 2024-04-26T17:58:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f0ad9564640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc0d5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f77cbb7f640 1 -- 172.21.15.12:0/3407167054 wait complete. 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f0ad9564640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc0de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3340476d0 con 0x7fb334005ec0 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3340f7740 con 0x7fb334005ec0 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e20171480 0x7f1e200cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f1e200d4f70 con 0x7f1e20050ca0 2024-04-26T17:58:43.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f1e20007430 con 0x7f1e20171480 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2f45b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1e200d50f0 con 0x7f1e200d7b70 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2d1f7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e20050ca0 0x7f1e201746e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2c9f6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2c9f6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48322/0 (socket says 172.21.15.12:48322) 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f1e2c9f6640 1 -- 172.21.15.12:0/542731129 learned_addr learned my addr 172.21.15.12:0/542731129 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2d9f8640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e20171480 0x7f1e200cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2c9f6640 1 -- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e20171480 msgr2=0x7f1e200cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2c9f6640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e20171480 0x7f1e200cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2c9f6640 1 -- 172.21.15.12:0/542731129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e20050ca0 msgr2=0x7f1e201746e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2c9f6640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e20050ca0 0x7f1e201746e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f1e2c9f6640 1 -- 172.21.15.12:0/542731129 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e200cfdf0 con 0x7f1e200d7b70 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 0x7f35040e4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 0x7f3504178bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 0x7f3504179130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f350404c730 con 0x7f35040dbab0 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f35040dd860 con 0x7f35040db6d0 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.184+0000 7f3513245640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f350404c8b0 con 0x7f35040dfb00 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f350bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 0x7f3504178bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f350bfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 0x7f3504178bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48338/0 (socket says 172.21.15.12:48338) 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f350bfff640 1 -- 172.21.15.12:0/2932649106 learned_addr learned my addr 172.21.15.12:0/2932649106 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f3510fe1640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 0x7f35040e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fa0b9aae640 1 --2- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40ca070 0x7fa0b40ca500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac008330 tx=0x7fa0ac00a7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b97728f7992823 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fa0abfff640 1 -- 172.21.15.12:0/2725410277 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac036070 con 0x7fa0b40ca070 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fa0abfff640 1 -- 172.21.15.12:0/2725410277 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0ac008640 con 0x7fa0b40ca070 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc0d5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad9564640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 0x7f0acc0de720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad9564640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc00e2a0 con 0x7f0acc04b090 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad9564640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0acc046a10 con 0x7f0acc0d5200 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad9564640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0acc00e420 con 0x7f0acc005e90 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad3fff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc0d5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48336/0 (socket says 172.21.15.12:48336) 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad3fff640 1 -- 172.21.15.12:0/2377535080 learned_addr learned my addr 172.21.15.12:0/2377535080 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad8d63640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 0x7f0acc0de720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f0ad37fe640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc0de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7fa0abfff640 1 -- 172.21.15.12:0/2725410277 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac008a30 con 0x7fa0b40ca070 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f0ad8d63640 1 -- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 msgr2=0x7f0acc0d5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f0ad8d63640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc0d5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f0ad8d63640 1 -- 172.21.15.12:0/2377535080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 msgr2=0x7f0acc0de1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f0ad8d63640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc0de1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f0ad8d63640 1 -- 172.21.15.12:0/2377535080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0acc178f60 con 0x7f0acc0d5200 2024-04-26T17:58:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.185+0000 7f35117e2640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 0x7f3504179130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f1e2c9f6640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800e960 tx=0x7f1e1800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18017070 con 0x7f1e200d7b70 2024-04-26T17:58:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18004020 con 0x7f1e200d7b70 2024-04-26T17:58:43.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e180043f0 con 0x7f1e200d7b70 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 -- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 msgr2=0x7f3504178bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 0x7f3504178bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 -- 172.21.15.12:0/2932649106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 msgr2=0x7f3504179130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 0x7f3504179130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 -- 172.21.15.12:0/2932649106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35040e4c00 con 0x7f35040db6d0 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f35117e2640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 0x7f3504179130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f3510fe1640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 0x7f35040e4370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3500007df0 tx=0x7f350000f1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f4e64cda640 1 Processor -- start 2024-04-26T17:58:43.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f4e64cda640 1 -- start start 2024-04-26T17:58:43.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7f77cbb7f640 1 Processor -- start 2024-04-26T17:58:43.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40ca070 msgr2=0x7fa0b40ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40ca070 0x7fa0b40ca500 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac008330 tx=0x7fa0ac00a7b0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.224 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f77cbb7f640 1 -- start start 2024-04-26T17:58:43.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 shutdown_connections 2024-04-26T17:58:43.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40ca070 0x7fa0b40ca500 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2725410277 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40c8980 0x7fa0b40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f0ad8d63640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 0x7f0acc0de720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4000b60 tx=0x7f0ad4076d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 >> 172.21.15.12:0/2725410277 conn(0x7fa0b406c310 msgr2=0x7fa0b406c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.186+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3340053c0 con 0x7fb334005ec0 2024-04-26T17:58:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350000fc50 con 0x7f35040db6d0 2024-04-26T17:58:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3500018070 con 0x7f35040db6d0 2024-04-26T17:58:43.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f3513245640 1 -- 172.21.15.12:0/2932649106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35040e4960 con 0x7f35040db6d0 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35000133f0 con 0x7f35040db6d0 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb32c0037b0 con 0x7fb334005ec0 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40742e0 con 0x7f0acc0d5200 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad4074480 con 0x7f0acc0d5200 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4074870 con 0x7f0acc0d5200 2024-04-26T17:58:43.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f4e64cda640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e200d5550 con 0x7f1e200d7b70 2024-04-26T17:58:43.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f77cbb7f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 0x7f77c41596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f4e64cda640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 0x7f4e600cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 shutdown_connections 2024-04-26T17:58:43.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7fa0bb511640 1 -- 172.21.15.12:0/2725410277 wait complete. 2024-04-26T17:58:43.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f4e5e59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e200d0090 con 0x7f1e200d7b70 2024-04-26T17:58:43.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7fb3327fc640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 0x7fb32006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb32c08bbe0 con 0x7fb334005ec0 2024-04-26T17:58:43.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.187+0000 7f3513245640 1 -- 172.21.15.12:0/2932649106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350417cb10 con 0x7f35040db6d0 2024-04-26T17:58:43.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f4e5e59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48342/0 (socket says 172.21.15.12:48342) 2024-04-26T17:58:43.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0acc179200 con 0x7f0acc0d5200 2024-04-26T17:58:43.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.188+0000 7f4e5e59c640 1 -- 172.21.15.12:0/369797902 learned_addr learned my addr 172.21.15.12:0/369797902 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 0x7f4e60143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.231 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0acc1797a0 con 0x7f0acc0d5200 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600ca880 con 0x7f4e6015c870 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e5ed9d640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 0x7f4e60143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e20005390 con 0x7f1e200d7b70 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4e600ca5a0 con 0x7f4e600ce6f0 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4e600c5630 con 0x7f4e600ce310 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e57fff640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 0x7f4e600cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e5ed9d640 1 -- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 msgr2=0x7f4e600ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e5ed9d640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e5ed9d640 1 -- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 msgr2=0x7f4e600cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7fb3416ad640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 0x7fb32006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7fb3416ad640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 0x7fb32006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb33c051c10 tx=0x7fb33c069470 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f4e5ed9d640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 0x7f4e600cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f4e5ed9d640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e601574c0 con 0x7f4e6015c870 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f4e5ed9d640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 0x7f4e60143930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ebd0 tx=0x7f4e5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f4e5e59c640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f4e57fff640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 0x7f4e600cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0acc005390 con 0x7f0acc0d5200 2024-04-26T17:58:43.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3500013590 con 0x7f35040db6d0 2024-04-26T17:58:43.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7fa0bb511640 1 Processor -- start 2024-04-26T17:58:43.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7fa0bb511640 1 -- start start 2024-04-26T17:58:43.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35040053c0 con 0x7f35040db6d0 2024-04-26T17:58:43.235 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58018020 con 0x7f4e6015c870 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77cbb7f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 0x7f77c40734e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77cbb7f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c41ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77cbb7f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4069600 con 0x7f77c40ca580 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77cbb7f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f77c415be60 con 0x7f77c41520f0 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77cbb7f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f77c4069780 con 0x7f77c40ca1a0 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77c991b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 0x7f77c41596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77c911a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 0x7f77c40734e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77c911a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 0x7f77c40734e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46828/0 (socket says 172.21.15.12:46828) 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77c911a640 1 -- 172.21.15.12:0/212088776 learned_addr learned my addr 172.21.15.12:0/212088776 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.189+0000 7f77ca11c640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c41ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f77c991b640 1 -- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 msgr2=0x7f77c41ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f77c991b640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c41ed220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f77c991b640 1 -- 172.21.15.12:0/212088776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 msgr2=0x7f77c40734e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f77c991b640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 0x7f77c40734e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.190+0000 7f77c991b640 1 -- 172.21.15.12:0/212088776 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4159e20 con 0x7f77c40ca1a0 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e5800cd20 con 0x7f4e6015c870 2024-04-26T17:58:43.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f35097fa640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 0x7f34f006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f350008c150 con 0x7f35040db6d0 2024-04-26T17:58:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e600cc7c0 con 0x7f4e6015c870 2024-04-26T17:58:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e60157a10 con 0x7f4e6015c870 2024-04-26T17:58:43.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f350bfff640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 0x7f34f006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f77c991b640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 0x7f77c41596c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77c415b590 tx=0x7f77b400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58014680 con 0x7f4e6015c870 2024-04-26T17:58:43.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0ad4075a80 con 0x7f0acc0d5200 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 0x7fa0b40c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 0x7fa0b4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 0x7fa0b41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b415b770 con 0x7fa0b4152330 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b415b490 con 0x7fa0b40c8980 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.191+0000 7fa0bb511640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b415ba50 con 0x7fa0b40ca070 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b8aac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 0x7fa0b4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b8aac640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 0x7fa0b4155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48362/0 (socket says 172.21.15.12:48362) 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 0x7fa0b40c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b8aac640 1 -- 172.21.15.12:0/2527593633 learned_addr learned my addr 172.21.15.12:0/2527593633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7f350bfff640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 0x7f34f006eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35040e3b40 tx=0x7f34f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7f0ad0ff9640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 0x7f0ab806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b9aae640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 0x7fa0b41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 -- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 msgr2=0x7fa0b4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 0x7fa0b4155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 -- 172.21.15.12:0/2527593633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 msgr2=0x7fa0b41562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 0x7fa0b41562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b92ad640 1 -- 172.21.15.12:0/2527593633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b4152f60 con 0x7fa0b40c8980 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ad4108520 con 0x7f0acc0d5200 2024-04-26T17:58:43.242 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7f0ad3fff640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 0x7f0ab806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.192+0000 7fa0b9aae640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 0x7fa0b41562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.193+0000 7fa0b92ad640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 0x7fa0b40c6f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4000f60 tx=0x7fa0a400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.193+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e60076d20 con 0x7f4e6015c870 2024-04-26T17:58:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.193+0000 7f0ad3fff640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 0x7f0ab806eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0007550 tx=0x7f0ac0007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.193+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e58005d10 con 0x7f4e6015c870 2024-04-26T17:58:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.193+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4028070 con 0x7f77c40ca1a0 2024-04-26T17:58:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b40050d0 con 0x7f77c40ca1a0 2024-04-26T17:58:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c415a100 con 0x7f77c40ca1a0 2024-04-26T17:58:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b4003610 con 0x7f77c40ca1a0 2024-04-26T17:58:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f4e56ffd640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 0x7f4e4006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c41f0cc0 con 0x7f77c40ca1a0 2024-04-26T17:58:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb32c0595d0 con 0x7fb334005ec0 2024-04-26T17:58:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e5808cb00 con 0x7f4e6015c870 2024-04-26T17:58:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f4e5e59c640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 0x7f4e4006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.194+0000 7f4e5e59c640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 0x7f4e4006ee00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e50038040 tx=0x7f4e50008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.195+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e1800ca00 con 0x7f1e200d7b70 2024-04-26T17:58:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.195+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ac005290 con 0x7f77c40ca1a0 2024-04-26T17:58:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.195+0000 7f1e1dffb640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 0x7f1e0c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.195+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1e1808c560 con 0x7f1e200d7b70 2024-04-26T17:58:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.195+0000 7f1e2d1f7640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 0x7f1e0c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.196+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3500059bd0 con 0x7f35040db6d0 2024-04-26T17:58:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.196+0000 7f1e2d1f7640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 0x7f1e0c06ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1e24006fd0 tx=0x7f1e24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.198+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e1805a070 con 0x7f1e200d7b70 2024-04-26T17:58:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.200+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77b402b070 con 0x7f77c40ca1a0 2024-04-26T17:58:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7f77ba7fc640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 0x7f77a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0ad40d5f10 con 0x7f0acc0d5200 2024-04-26T17:58:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f77b4067ef0 con 0x7f77c40ca1a0 2024-04-26T17:58:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4017070 con 0x7fa0b40c8980 2024-04-26T17:58:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0a4005ce0 con 0x7fa0b40c8980 2024-04-26T17:58:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.201+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40072d0 con 0x7fa0b40c8980 2024-04-26T17:58:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.202+0000 7f77c911a640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 0x7f77a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.202+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b41ed990 con 0x7fa0b40c8980 2024-04-26T17:58:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.202+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41edf50 con 0x7fa0b40c8980 2024-04-26T17:58:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.202+0000 7f77c911a640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 0x7f77a806ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000f80 tx=0x7f77bc00e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.203+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b40506c0 con 0x7fa0b40c8980 2024-04-26T17:58:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.204+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77b4032020 con 0x7f77c40ca1a0 2024-04-26T17:58:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.204+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4e58022030 con 0x7f4e6015c870 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.204+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0a401a070 con 0x7fa0b40c8980 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.205+0000 7fa0a9ffb640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 0x7fa09806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.205+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa0a4056c10 con 0x7fa0b40c8980 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.206+0000 7fa0b8aac640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 0x7fa09806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.206+0000 7fa0b8aac640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 0x7fa09806ee30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000b240 tx=0x7fa0b000b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.211+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa0a4058b70 con 0x7fa0b40c8980 2024-04-26T17:58:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.557+0000 7feed8ff9640 1 -- 172.21.15.12:0/674570023 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7feecc005580 con 0x7feee41888d0 2024-04-26T17:58:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.558+0000 7feedaffd640 1 -- 172.21.15.12:0/674570023 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feedc059a30 con 0x7feee41888d0 2024-04-26T17:58:43.557 INFO:teuthology.orchestra.run.smithi012.stdout:55834574858 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 msgr2=0x7feed4070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 0x7feed4070520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feee0009810 tx=0x7feee0009190 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 msgr2=0x7feee4047630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feedc00fb90 tx=0x7feedc00d520 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 shutdown_connections 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feee4047b70 0x7feee40ecb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7feed406e060 0x7feed4070520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.561+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feee41888d0 0x7feee4047630 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.562+0000 7feeeb59e640 1 --2- 172.21.15.12:0/674570023 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feee41884f0 0x7feee40f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.562+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 >> 172.21.15.12:0/674570023 conn(0x7feee4050180 msgr2=0x7feee40f0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.562+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 shutdown_connections 2024-04-26T17:58:43.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.562+0000 7feeeb59e640 1 -- 172.21.15.12:0/674570023 wait complete. 2024-04-26T17:58:43.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-26T17:58:43.582 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.601+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1e200d3cd0 con 0x7f1e200d7b70 2024-04-26T17:58:43.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.601+0000 7f1e1dffb640 1 -- 172.21.15.12:0/542731129 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1e1805e370 con 0x7f1e200d7b70 2024-04-26T17:58:43.601 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:43.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.603+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 msgr2=0x7f1e0c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.603+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 0x7f1e0c06ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1e24006fd0 tx=0x7f1e24008040 comp rx=0 tx=0).stop 2024-04-26T17:58:43.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.603+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 msgr2=0x7f1e20170f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.603+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800e960 tx=0x7f1e1800ee20 comp rx=0 tx=0).stop 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 shutdown_connections 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1e20171480 0x7f1e200cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f1e0c06c9c0 0x7f1e0c06ee80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1e200d7b70 0x7f1e20170f40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 --2- 172.21.15.12:0/542731129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e20050ca0 0x7f1e201746e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 >> 172.21.15.12:0/542731129 conn(0x7f1e20050180 msgr2=0x7f1e2004c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 shutdown_connections 2024-04-26T17:58:43.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.604+0000 7f1e2f45b640 1 -- 172.21.15.12:0/542731129 wait complete. 2024-04-26T17:58:43.614 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-26T17:58:43.614 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.631+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb33404c290 con 0x7fb334005ec0 2024-04-26T17:58:43.631 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.632+0000 7fb3327fc640 1 -- 172.21.15.12:0/4003185877 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb32c05d8d0 con 0x7fb334005ec0 2024-04-26T17:58:43.631 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:43.633 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 msgr2=0x7fb32006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 0x7fb32006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb33c051c10 tx=0x7fb33c069470 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 msgr2=0x7fb3340f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 0x7fb3340f4eb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb32c00c610 tx=0x7fb32c00cad0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 shutdown_connections 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3340fc9b0 0x7fb33404f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb334045250 0x7fb334048210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb32006c9f0 0x7fb32006eeb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 --2- 172.21.15.12:0/4003185877 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb334005ec0 0x7fb3340f4eb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 >> 172.21.15.12:0/4003185877 conn(0x7fb3340501b0 msgr2=0x7fb334050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 shutdown_connections 2024-04-26T17:58:43.634 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.634+0000 7fb344112640 1 -- 172.21.15.12:0/4003185877 wait complete. 2024-04-26T17:58:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.635+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f350404bc90 con 0x7f35040db6d0 2024-04-26T17:58:43.635 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.635+0000 7f35097fa640 1 -- 172.21.15.12:0/2932649106 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f350005ded0 con 0x7f35040db6d0 2024-04-26T17:58:43.635 INFO:teuthology.orchestra.run.smithi012.stdout:55834574860 2024-04-26T17:58:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.636+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4e60068b30 con 0x7f4e6015c870 2024-04-26T17:58:43.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.637+0000 7f4e56ffd640 1 -- 172.21.15.12:0/369797902 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4e5808ce20 con 0x7f4e6015c870 2024-04-26T17:58:43.636 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.638+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f77ac005850 con 0x7f77c40ca1a0 2024-04-26T17:58:43.637 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.638+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0acc04bc60 con 0x7f0acc0d5200 2024-04-26T17:58:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f77ba7fc640 1 -- 172.21.15.12:0/212088776 <== mon.2 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f77b4032020 con 0x7f77c40ca1a0 2024-04-26T17:58:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 msgr2=0x7f34f006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 0x7f34f006eeb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f35040e3b40 tx=0x7f34f802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 msgr2=0x7f35040e4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 0x7f35040e4370 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3500007df0 tx=0x7f350000f1d0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f0ad0ff9640 1 -- 172.21.15.12:0/2377535080 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0ad40da210 con 0x7f0acc0d5200 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 shutdown_connections 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35040dbab0 0x7f3504179130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f34f006c9f0 0x7f34f006eeb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f35040dfb00 0x7f3504178bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 --2- 172.21.15.12:0/2932649106 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35040db6d0 0x7f35040e4370 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 >> 172.21.15.12:0/2932649106 conn(0x7f35040501b0 msgr2=0x7f3504045770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.640 INFO:teuthology.orchestra.run.smithi012.stdout:55834574860 2024-04-26T17:58:43.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 shutdown_connections 2024-04-26T17:58:43.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f34f6ffd640 1 -- 172.21.15.12:0/2932649106 wait complete. 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 msgr2=0x7f4e4006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 0x7f4e4006ee00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4e50038040 tx=0x7f4e50008030 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 msgr2=0x7f4e60143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.639+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 0x7f4e60143930 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800ebd0 tx=0x7f4e5800c490 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 shutdown_connections 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6015c870 0x7f4e60143930 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e600ce6f0 0x7f4e600cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4e4006c940 0x7f4e4006ee00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 --2- 172.21.15.12:0/369797902 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e600ce310 0x7f4e600ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 >> 172.21.15.12:0/369797902 conn(0x7f4e60073710 msgr2=0x7f4e60158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 shutdown_connections 2024-04-26T17:58:43.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.640+0000 7f4e64cda640 1 -- 172.21.15.12:0/369797902 wait complete. 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 msgr2=0x7f77a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 0x7f77a806ede0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f77bc000f80 tx=0x7f77bc00e040 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 msgr2=0x7f77c41596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 0x7f77c41596c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f77c415b590 tx=0x7f77b400c890 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 shutdown_connections 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77c41520f0 0x7f77c41ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77c40ca580 0x7f77c40734e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.642+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f77a806c920 0x7f77a806ede0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f77cbb7f640 1 --2- 172.21.15.12:0/212088776 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f77c40ca1a0 0x7f77c41596c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 >> 172.21.15.12:0/212088776 conn(0x7f77c4076820 msgr2=0x7f77c4150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 msgr2=0x7f0ab806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 0x7f0ab806eeb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0007550 tx=0x7f0ac0007ba0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 msgr2=0x7f0acc0de720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 0x7f0acc0de720 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4000b60 tx=0x7f0ad4076d20 comp rx=0 tx=0).stop 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 shutdown_connections 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 shutdown_connections 2024-04-26T17:58:43.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0acc0d5200 0x7f0acc0de720 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f77cbb7f640 1 -- 172.21.15.12:0/212088776 wait complete. 2024-04-26T17:58:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0acc04b090 0x7f0acc0de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0ab806c9f0 0x7f0ab806eeb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 --2- 172.21.15.12:0/2377535080 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0acc005e90 0x7f0acc0d5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 >> 172.21.15.12:0/2377535080 conn(0x7f0acc050180 msgr2=0x7f0acc0d1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 shutdown_connections 2024-04-26T17:58:43.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.643+0000 7f0ad9564640 1 -- 172.21.15.12:0/2377535080 wait complete. 2024-04-26T17:58:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.650+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa0b414c3b0 con 0x7fa0b40c8980 2024-04-26T17:58:43.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.650+0000 7fa0a9ffb640 1 -- 172.21.15.12:0/2527593633 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0a40616a0 con 0x7fa0b40c8980 2024-04-26T17:58:43.649 INFO:teuthology.orchestra.run.smithi012.stdout:55834574859 2024-04-26T17:58:43.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-26T17:58:43.652 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 msgr2=0x7fa09806ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 0x7fa09806ee30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000b240 tx=0x7fa0b000b3a0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 msgr2=0x7fa0b40c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 0x7fa0b40c6f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4000f60 tx=0x7fa0a400c800 comp rx=0 tx=0).stop 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 shutdown_connections 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa0b4152330 0x7fa0b41562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa09806c970 0x7fa09806ee30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa0b40ca070 0x7fa0b4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 --2- 172.21.15.12:0/2527593633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0b40c8980 0x7fa0b40c6f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 >> 172.21.15.12:0/2527593633 conn(0x7fa0b406c310 msgr2=0x7fa0b41500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 shutdown_connections 2024-04-26T17:58:43.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.654+0000 7fa0bb511640 1 -- 172.21.15.12:0/2527593633 wait complete. 2024-04-26T17:58:43.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-26T17:58:43.656 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-04-26T17:58:43.656 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-04-26T17:58:43.660 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2024-04-26T17:58:43.662 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-04-26T17:58:43.667 DEBUG:teuthology.parallel:result is None 2024-04-26T17:58:43.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:43.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:43.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:43.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:58:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.810+0000 7f75043f0640 1 Processor -- start 2024-04-26T17:58:43.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.810+0000 7f75043f0640 1 -- start start 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f75043f0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 0x7f74fc15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f75043f0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74fc156180 0x7f74fc0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f75043f0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74fc15f2a0 con 0x7f74fc0cd840 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f75043f0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f74fc15cbc0 con 0x7f74fc156180 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f75043f0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f74fc0cc730 con 0x7f74fc155da0 2024-04-26T17:58:43.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74fc156180 0x7f74fc0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f74fc156180 0x7f74fc0d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46834/0 (socket says 172.21.15.12:46834) 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 -- 172.21.15.12:0/3863752683 learned_addr learned my addr 172.21.15.12:0/3863752683 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750218c640 1 --2- 172.21.15.12:0/3863752683 >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 0x7f74fc15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 -- 172.21.15.12:0/3863752683 >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 msgr2=0x7f74fc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 --2- 172.21.15.12:0/3863752683 >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 0x7f74fc15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 -- 172.21.15.12:0/3863752683 >> v1:172.21.15.100:6789/0 conn(0x7f74fc0cd840 legacy=0x7f74fc0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750198b640 1 -- 172.21.15.12:0/3863752683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc15f580 con 0x7f74fc156180 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.811+0000 7f750218c640 1 --2- 172.21.15.12:0/3863752683 >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 0x7f74fc15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.812+0000 7f750198b640 1 --2- 172.21.15.12:0/3863752683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc156180 0x7f74fc0d12c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0d2150 tx=0x7f74ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e2005607806dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.812+0000 7f750118a640 1 -- 172.21.15.12:0/3863752683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec037070 con 0x7f74fc156180 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.812+0000 7f750118a640 1 -- 172.21.15.12:0/3863752683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec032440 con 0x7f74fc156180 2024-04-26T17:58:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.812+0000 7f750118a640 1 -- 172.21.15.12:0/3863752683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec032810 con 0x7f74fc156180 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 -- 172.21.15.12:0/3863752683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc156180 msgr2=0x7f74fc0d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 --2- 172.21.15.12:0/3863752683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc156180 0x7f74fc0d12c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0d2150 tx=0x7f74ec02a1a0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 -- 172.21.15.12:0/3863752683 shutdown_connections 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 --2- 172.21.15.12:0/3863752683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc156180 0x7f74fc0d12c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 --2- 172.21.15.12:0/3863752683 >> v2:172.21.15.100:3300/0 conn(0x7f74fc155da0 0x7f74fc15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 -- 172.21.15.12:0/3863752683 >> 172.21.15.12:0/3863752683 conn(0x7f74fc068090 msgr2=0x7f74fc0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 -- 172.21.15.12:0/3863752683 shutdown_connections 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.813+0000 7f75043f0640 1 -- 172.21.15.12:0/3863752683 wait complete. 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.814+0000 7f75043f0640 1 Processor -- start 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.814+0000 7f75043f0640 1 -- start start 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74fc0cd840 0x7f74fc1e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74fc155da0 0x7f74fc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc0c69b0 con 0x7f74fc15e690 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc15fb40 con 0x7f74fc155da0 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f74fc0c6b30 con 0x7f74fc0cd840 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46842/0 (socket says 172.21.15.12:46842) 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 -- 172.21.15.12:0/3979019239 learned_addr learned my addr 172.21.15.12:0/3979019239 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750198b640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74fc155da0 0x7f74fc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750218c640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74fc0cd840 0x7f74fc1e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 -- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74fc0cd840 msgr2=0x7f74fc1e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74fc0cd840 0x7f74fc1e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 -- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74fc155da0 msgr2=0x7f74fc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74fc155da0 0x7f74fc14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 -- 172.21.15.12:0/3979019239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc14c600 con 0x7f74fc15e690 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f750298d640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74f400ba40 tx=0x7f74f400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400cb80 con 0x7f74fc15e690 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f400cd20 con 0x7f74fc15e690 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.815+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc155320 con 0x7f74fc15e690 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.816+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4003bb0 con 0x7f74fc15e690 2024-04-26T17:58:43.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.816+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc1f25a0 con 0x7f74fc15e690 2024-04-26T17:58:43.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.816+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc076d20 con 0x7f74fc15e690 2024-04-26T17:58:43.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.817+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74f4014440 con 0x7f74fc15e690 2024-04-26T17:58:43.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.817+0000 7f74f2ffd640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 0x7f74e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:43.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.818+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f74f408bc70 con 0x7f74fc15e690 2024-04-26T17:58:43.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.818+0000 7f750218c640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 0x7f74e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:43.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.818+0000 7f750218c640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 0x7f74e006ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74f800a990 tx=0x7f74f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:43.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:43.822+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74fc14c600 con 0x7f74fc15e690 2024-04-26T17:58:44.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.006+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f74fc14f090 con 0x7f74e006c920 2024-04-26T17:58:44.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.014+0000 7f74f2ffd640 1 -- 172.21.15.12:0/3979019239 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f74fc14f090 con 0x7f74e006c920 2024-04-26T17:58:44.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:44.019 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:44.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 msgr2=0x7f74e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 0x7f74e006ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74f800a990 tx=0x7f74f8008040 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 msgr2=0x7f74fc15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f74f400ba40 tx=0x7f74f400bf00 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 shutdown_connections 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74fc15e690 0x7f74fc15eb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74fc155da0 0x7f74fc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f74e006c920 0x7f74e006ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 --2- 172.21.15.12:0/3979019239 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f74fc0cd840 0x7f74fc1e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 >> 172.21.15.12:0/3979019239 conn(0x7f74fc068090 msgr2=0x7f74fc0cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 shutdown_connections 2024-04-26T17:58:44.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.018+0000 7f75043f0640 1 -- 172.21.15.12:0/3979019239 wait complete. 2024-04-26T17:58:44.028 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T17:58:43.881706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003236"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:44.033 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:44.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 Processor -- start 2024-04-26T17:58:44.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 -- start start 2024-04-26T17:58:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9290155d90 0x7f929006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f929015bb20 con 0x7f92900ce090 2024-04-26T17:58:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92900c8b60 con 0x7f929015c6f0 2024-04-26T17:58:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.171+0000 7f929527b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f92900c8e40 con 0x7f9290155d90 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9290155d90 0x7f929006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f9287fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92900ce090 0x7f929015bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56508/0 (socket says 172.21.15.12:56508) 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9290155d90 0x7f929006dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46848/0 (socket says 172.21.15.12:46848) 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f9287fff640 1 -- 172.21.15.12:0/3557310522 learned_addr learned my addr 172.21.15.12:0/3557310522 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928effd640 1 -- 172.21.15.12:0/3557310522 >> v1:172.21.15.100:6789/0 conn(0x7f929015c6f0 legacy=0x7f92901664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928effd640 1 -- 172.21.15.12:0/3557310522 >> v1:172.21.15.12:6789/0 conn(0x7f92900ce090 legacy=0x7f929015bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928e7fc640 1 -- 172.21.15.12:0/3557310522 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850935837 0 0) 0x7f9278001110 con 0x7f92900ce090 2024-04-26T17:58:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.172+0000 7f928effd640 1 -- 172.21.15.12:0/3557310522 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92900c9120 con 0x7f9290155d90 2024-04-26T17:58:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f928effd640 1 --2- 172.21.15.12:0/3557310522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9290155d90 0x7f929006dd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92800097a0 tx=0x7f928002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07304b0fca90269 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f928e7fc640 1 -- 172.21.15.12:0/3557310522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037070 con 0x7f9290155d90 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f928e7fc640 1 -- 172.21.15.12:0/3557310522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9280032440 con 0x7f9290155d90 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f928e7fc640 1 -- 172.21.15.12:0/3557310522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280032810 con 0x7f9290155d90 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 -- 172.21.15.12:0/3557310522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9290155d90 msgr2=0x7f929006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 --2- 172.21.15.12:0/3557310522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9290155d90 0x7f929006dd60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f92800097a0 tx=0x7f928002a270 comp rx=0 tx=0).stop 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 -- 172.21.15.12:0/3557310522 shutdown_connections 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 --2- 172.21.15.12:0/3557310522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9290155d90 0x7f929006dd60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 -- 172.21.15.12:0/3557310522 >> 172.21.15.12:0/3557310522 conn(0x7f929006c970 msgr2=0x7f92900cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 -- 172.21.15.12:0/3557310522 shutdown_connections 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.173+0000 7f929527b640 1 -- 172.21.15.12:0/3557310522 wait complete. 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.174+0000 7f929527b640 1 Processor -- start 2024-04-26T17:58:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 -- start start 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9290155d90 0x7f9290153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f929015c6f0 0x7f929014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f92901562f0 con 0x7f92900ce090 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9290156170 con 0x7f929015c6f0 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f929527b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f92900c80d0 con 0x7f9290155d90 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f928effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f928effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46854/0 (socket says 172.21.15.12:46854) 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f928effd640 1 -- 172.21.15.12:0/1266929249 learned_addr learned my addr 172.21.15.12:0/1266929249 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f928f7fe640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f929015c6f0 0x7f929014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.175+0000 7f9287fff640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9290155d90 0x7f9290153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 -- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9290155d90 msgr2=0x7f9290153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9290155d90 0x7f9290153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 -- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f929015c6f0 msgr2=0x7f929014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f929015c6f0 0x7f929014f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 -- 172.21.15.12:0/1266929249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92901f2450 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f928effd640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f92800098c0 tx=0x7f92800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280041070 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928003c930 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929015a280 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280037040 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.176+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9290158f80 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.177+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9290072530 con 0x7f92900ce090 2024-04-26T17:58:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.178+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9280044070 con 0x7f92900ce090 2024-04-26T17:58:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.178+0000 7f92877fe640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 0x7f927006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.178+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92800aca50 con 0x7f92900ce090 2024-04-26T17:58:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.178+0000 7f9287fff640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 0x7f927006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.179+0000 7f9287fff640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 0x7f927006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92900c7660 tx=0x7f9278007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.182+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9290072530 con 0x7f92900ce090 2024-04-26T17:58:44.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.364+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9290076d20 con 0x7f927006c8f0 2024-04-26T17:58:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.373+0000 7f92877fe640 1 -- 172.21.15.12:0/1266929249 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9290076d20 con 0x7f927006c8f0 2024-04-26T17:58:44.375 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 msgr2=0x7f927006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 0x7f927006edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f92900c7660 tx=0x7f9278007970 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 msgr2=0x7f9290159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f92800098c0 tx=0x7f92800046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 shutdown_connections 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f929015c6f0 0x7f929014f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f927006c8f0 0x7f927006edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9290155d90 0x7f9290153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 --2- 172.21.15.12:0/1266929249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92900ce090 0x7f9290159d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 >> 172.21.15.12:0/1266929249 conn(0x7f929006c970 msgr2=0x7f929015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 shutdown_connections 2024-04-26T17:58:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.376+0000 7f929527b640 1 -- 172.21.15.12:0/1266929249 wait complete. 2024-04-26T17:58:44.387 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-26T17:58:43.881706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003236"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:44.391 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:44.391 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T17:58:44.391 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T17:58:44.392 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T17:58:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.529+0000 7fae22e25640 1 Processor -- start 2024-04-26T17:58:44.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.529+0000 7fae22e25640 1 -- start start 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae22e25640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae1c155da0 0x7fae1c15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae22e25640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c156180 0x7fae1c0d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae22e25640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c15f2a0 con 0x7fae1c0cd840 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae22e25640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c15cbc0 con 0x7fae1c155da0 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae22e25640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0cc730 con 0x7fae1c156180 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae20bc1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fae1c155da0 0x7fae1c15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae213c2640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae1c0cd840 0x7fae1c0c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56512/0 (socket says 172.21.15.12:56512) 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae213c2640 1 -- 172.21.15.12:0/1042824882 learned_addr learned my addr 172.21.15.12:0/1042824882 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae1bfff640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c156180 0x7fae1c0d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae20bc1640 1 -- 172.21.15.12:0/1042824882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c156180 msgr2=0x7fae1c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae20bc1640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c156180 0x7fae1c0d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae20bc1640 1 -- 172.21.15.12:0/1042824882 >> v1:172.21.15.12:6789/0 conn(0x7fae1c0cd840 legacy=0x7fae1c0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae1b7fe640 1 -- 172.21.15.12:0/1042824882 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284242828 0 0) 0x7fae1c15f2a0 con 0x7fae1c0cd840 2024-04-26T17:58:44.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.530+0000 7fae20bc1640 1 -- 172.21.15.12:0/1042824882 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c15f580 con 0x7fae1c155da0 2024-04-26T17:58:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.531+0000 7fae20bc1640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c15c680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae14009d90 tx=0x7fae1402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62d0be5b621fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.531+0000 7fae1b7fe640 1 -- 172.21.15.12:0/1042824882 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14031600 con 0x7fae1c155da0 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.531+0000 7fae1b7fe640 1 -- 172.21.15.12:0/1042824882 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae140317a0 con 0x7fae1c155da0 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.531+0000 7fae1b7fe640 1 -- 172.21.15.12:0/1042824882 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14031b70 con 0x7fae1c155da0 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 -- 172.21.15.12:0/1042824882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 msgr2=0x7fae1c15c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c15c680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae14009d90 tx=0x7fae1402a5d0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 -- 172.21.15.12:0/1042824882 shutdown_connections 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c156180 0x7fae1c0d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 --2- 172.21.15.12:0/1042824882 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c15c680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 -- 172.21.15.12:0/1042824882 >> 172.21.15.12:0/1042824882 conn(0x7fae1c068090 msgr2=0x7fae1c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 -- 172.21.15.12:0/1042824882 shutdown_connections 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.532+0000 7fae22e25640 1 -- 172.21.15.12:0/1042824882 wait complete. 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.533+0000 7fae22e25640 1 Processor -- start 2024-04-26T17:58:44.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.533+0000 7fae22e25640 1 -- start start 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c0cd840 0x7fae1c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 0x7fae1c1f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0c69b0 con 0x7fae1c155da0 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c15fb40 con 0x7fae1c15c070 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae22e25640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0c6b30 con 0x7fae1c0cd840 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46868/0 (socket says 172.21.15.12:46868) 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 -- 172.21.15.12:0/2530983213 learned_addr learned my addr 172.21.15.12:0/2530983213 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae20bc1640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c0cd840 0x7fae1c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae213c2640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 0x7fae1c1f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 -- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c0cd840 msgr2=0x7fae1c1f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c0cd840 0x7fae1c1f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 -- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 msgr2=0x7fae1c1f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 0x7fae1c1f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 -- 172.21.15.12:0/2530983213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c156690 con 0x7fae1c155da0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae213c2640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 0x7fae1c1f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae1bfff640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae0400d830 tx=0x7fae0400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.534+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400b660 con 0x7fae1c155da0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.535+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04019070 con 0x7fae1c155da0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.535+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c159ab0 con 0x7fae1c155da0 2024-04-26T17:58:44.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.535+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400ba20 con 0x7fae1c155da0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.535+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c15a070 con 0x7fae1c155da0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.535+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c0cd630 con 0x7fae1c155da0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.536+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae0401e460 con 0x7fae1c155da0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.536+0000 7fae197fa640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 0x7fadfc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.536+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fae0408c430 con 0x7fae1c155da0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.537+0000 7fae20bc1640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 0x7fadfc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.537+0000 7fae20bc1640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 0x7fadfc06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae14034000 tx=0x7fae1402f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.541+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae1c0cd630 con 0x7fae1c155da0 2024-04-26T17:58:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.767+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fae1c076d20 con 0x7fae1c155da0 2024-04-26T17:58:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.767+0000 7fae197fa640 1 -- 172.21.15.12:0/2530983213 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fae0405a5b0 con 0x7fae1c155da0 2024-04-26T17:58:44.767 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:44.767 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T17:58:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 msgr2=0x7fadfc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 0x7fadfc06ede0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fae14034000 tx=0x7fae1402f000 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 msgr2=0x7fae1c1460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae0400d830 tx=0x7fae0400dcf0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 shutdown_connections 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae1c15c070 0x7fae1c1f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae1c155da0 0x7fae1c1460f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadfc06c920 0x7fadfc06ede0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 --2- 172.21.15.12:0/2530983213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fae1c0cd840 0x7fae1c1f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 >> 172.21.15.12:0/2530983213 conn(0x7fae1c068090 msgr2=0x7fae1c1545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 shutdown_connections 2024-04-26T17:58:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.769+0000 7fae22e25640 1 -- 172.21.15.12:0/2530983213 wait complete. 2024-04-26T17:58:44.779 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T17:58:44.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:44.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.881+0000 7eff4aac4640 1 Processor -- start 2024-04-26T17:58:44.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.881+0000 7eff4aac4640 1 -- start start 2024-04-26T17:58:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 0x7eff4415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 0x7eff440d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff440cd840 0x7eff440d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7eff4415cbc0 con 0x7eff440cd840 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7eff440cc730 con 0x7eff44155da0 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff4aac4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7eff4415f2a0 con 0x7eff44156180 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff440cd840 0x7eff440d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff440cd840 0x7eff440d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46876/0 (socket says 172.21.15.12:46876) 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 -- 172.21.15.12:0/2100970190 learned_addr learned my addr 172.21.15.12:0/2100970190 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff48860640 1 --2- 172.21.15.12:0/2100970190 >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 0x7eff4415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff43fff640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 0x7eff440d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 -- 172.21.15.12:0/2100970190 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 msgr2=0x7eff440d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 0x7eff440d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 -- 172.21.15.12:0/2100970190 >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 msgr2=0x7eff4415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 --2- 172.21.15.12:0/2100970190 >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 0x7eff4415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.883 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.882+0000 7eff49061640 1 -- 172.21.15.12:0/2100970190 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4415f580 con 0x7eff440cd840 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff48860640 1 --2- 172.21.15.12:0/2100970190 >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 0x7eff4415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff43fff640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 0x7eff440d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff49061640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff440d1800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff440d2150 tx=0x7eff3c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97851114e4371609 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff437fe640 1 -- 172.21.15.12:0/2100970190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c036070 con 0x7eff440cd840 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff437fe640 1 -- 172.21.15.12:0/2100970190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c031600 con 0x7eff440cd840 2024-04-26T17:58:44.884 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.883+0000 7eff437fe640 1 -- 172.21.15.12:0/2100970190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c0319d0 con 0x7eff440cd840 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 -- 172.21.15.12:0/2100970190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 msgr2=0x7eff440d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff440d1800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7eff440d2150 tx=0x7eff3c02a610 comp rx=0 tx=0).stop 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 -- 172.21.15.12:0/2100970190 shutdown_connections 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff440d1800 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 --2- 172.21.15.12:0/2100970190 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44156180 0x7eff440d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 --2- 172.21.15.12:0/2100970190 >> v2:172.21.15.100:3300/0 conn(0x7eff44155da0 0x7eff4415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 -- 172.21.15.12:0/2100970190 >> 172.21.15.12:0/2100970190 conn(0x7eff44068090 msgr2=0x7eff440684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 -- 172.21.15.12:0/2100970190 shutdown_connections 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.884+0000 7eff4aac4640 1 -- 172.21.15.12:0/2100970190 wait complete. 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.885+0000 7eff4aac4640 1 Processor -- start 2024-04-26T17:58:44.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.885+0000 7eff4aac4640 1 -- start start 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 0x7eff4415b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 0x7eff4415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff440cc160 con 0x7eff440cd840 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff4415fb40 con 0x7eff441515f0 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff4aac4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7eff440cc2e0 con 0x7eff44155da0 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46886/0 (socket says 172.21.15.12:46886) 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 -- 172.21.15.12:0/1773605742 learned_addr learned my addr 172.21.15.12:0/1773605742 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff49061640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 0x7eff4415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff43fff640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 0x7eff4415b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 -- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 msgr2=0x7eff4415b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 0x7eff4415b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 -- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 msgr2=0x7eff4415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 0x7eff4415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 -- 172.21.15.12:0/1773605742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4415ac10 con 0x7eff440cd840 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff49061640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 0x7eff4415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff43fff640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 0x7eff4415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.886+0000 7eff48860640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c7f0 tx=0x7eff3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.887+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38015070 con 0x7eff440cd840 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.887+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38007820 con 0x7eff440cd840 2024-04-26T17:58:44.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.887+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff441567a0 con 0x7eff440cd840 2024-04-26T17:58:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.887+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38007bd0 con 0x7eff440cd840 2024-04-26T17:58:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.887+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff441f22c0 con 0x7eff440cd840 2024-04-26T17:58:44.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.888+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44076d20 con 0x7eff440cd840 2024-04-26T17:58:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.888+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff38018070 con 0x7eff440cd840 2024-04-26T17:58:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.889+0000 7eff417fa640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.889+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7eff3808bfa0 con 0x7eff440cd840 2024-04-26T17:58:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.889+0000 7eff43fff640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:44.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.889+0000 7eff43fff640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 0x7eff2806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7eff44159630 tx=0x7eff30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:44.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:44.893+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff3805a090 con 0x7eff440cd840 2024-04-26T17:58:45.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.115+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff4414fe20 con 0x7eff440cd840 2024-04-26T17:58:45.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.116+0000 7eff417fa640 1 -- 172.21.15.12:0/1773605742 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7eff38059990 con 0x7eff440cd840 2024-04-26T17:58:45.115 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:45.116 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:45.116 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 msgr2=0x7eff2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 0x7eff2806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7eff44159630 tx=0x7eff30008040 comp rx=0 tx=0).stop 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 msgr2=0x7eff441538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c7f0 tx=0x7eff3800ccb0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 shutdown_connections 2024-04-26T17:58:45.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff441515f0 0x7eff4415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7eff2806c8f0 0x7eff2806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff44155da0 0x7eff4415b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 --2- 172.21.15.12:0/1773605742 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff440cd840 0x7eff441538a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 >> 172.21.15.12:0/1773605742 conn(0x7eff44068090 msgr2=0x7eff440c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 shutdown_connections 2024-04-26T17:58:45.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.118+0000 7eff4aac4640 1 -- 172.21.15.12:0/1773605742 wait complete. 2024-04-26T17:58:45.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.230+0000 7f6652396640 1 Processor -- start 2024-04-26T17:58:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.230+0000 7f6652396640 1 -- start start 2024-04-26T17:58:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6652396640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c155c90 0x7f664c0735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6652396640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f664c15c5b0 0x7f664c0d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6652396640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664c0c6330 con 0x7f664c0d1cc0 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6652396640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f664c156070 con 0x7f664c15c5b0 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6652396640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f664c0c6610 con 0x7f664c155c90 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664b7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f664c15c5b0 0x7f664c0d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6650933640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f664c0d1cc0 0x7f664c15d020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56518/0 (socket says 172.21.15.12:56518) 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f6650933640 1 -- 172.21.15.12:0/288539925 learned_addr learned my addr 172.21.15.12:0/288539925 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664bfff640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c155c90 0x7f664c0735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664b7fe640 1 -- 172.21.15.12:0/288539925 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c155c90 msgr2=0x7f664c0735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664b7fe640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c155c90 0x7f664c0735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664b7fe640 1 -- 172.21.15.12:0/288539925 >> v1:172.21.15.12:6789/0 conn(0x7f664c0d1cc0 legacy=0x7f664c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664b7fe640 1 -- 172.21.15.12:0/288539925 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c0c68f0 con 0x7f664c15c5b0 2024-04-26T17:58:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.231+0000 7f664affd640 1 -- 172.21.15.12:0/288539925 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917806105 0 0) 0x7f664c0c6330 con 0x7f664c0d1cc0 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.232+0000 7f664b7fe640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c15c5b0 0x7f664c0d1780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f66400097a0 tx=0x7f664002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6892a823491ba0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.232+0000 7f664affd640 1 -- 172.21.15.12:0/288539925 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640037070 con 0x7f664c15c5b0 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.232+0000 7f664affd640 1 -- 172.21.15.12:0/288539925 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6640032440 con 0x7f664c15c5b0 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.232+0000 7f664affd640 1 -- 172.21.15.12:0/288539925 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640032810 con 0x7f664c15c5b0 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 -- 172.21.15.12:0/288539925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c15c5b0 msgr2=0x7f664c0d1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c15c5b0 0x7f664c0d1780 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f66400097a0 tx=0x7f664002a210 comp rx=0 tx=0).stop 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 -- 172.21.15.12:0/288539925 shutdown_connections 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c15c5b0 0x7f664c0d1780 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 --2- 172.21.15.12:0/288539925 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c155c90 0x7f664c0735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 -- 172.21.15.12:0/288539925 >> 172.21.15.12:0/288539925 conn(0x7f664c074030 msgr2=0x7f664c074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 -- 172.21.15.12:0/288539925 shutdown_connections 2024-04-26T17:58:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.233+0000 7f6652396640 1 -- 172.21.15.12:0/288539925 wait complete. 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.234+0000 7f6652396640 1 Processor -- start 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.234+0000 7f6652396640 1 -- start start 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0d1cc0 0x7f664c156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c15c5b0 0x7f664c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f664c0c7190 con 0x7f664c155c90 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f664c0c6eb0 con 0x7f664c15c5b0 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6652396640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f664c15c9f0 con 0x7f664c0d1cc0 2024-04-26T17:58:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46904/0 (socket says 172.21.15.12:46904) 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 -- 172.21.15.12:0/3616571159 learned_addr learned my addr 172.21.15.12:0/3616571159 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664bfff640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0d1cc0 0x7f664c156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f6650933640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c15c5b0 0x7f664c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 -- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0d1cc0 msgr2=0x7f664c156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0d1cc0 0x7f664c156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 -- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c15c5b0 msgr2=0x7f664c0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c15c5b0 0x7f664c0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 -- 172.21.15.12:0/3616571159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664c0cae20 con 0x7f664c155c90 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.235+0000 7f664b7fe640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6640000c00 tx=0x7f66400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.236+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640037040 con 0x7f664c155c90 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.236+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6640004250 con 0x7f664c155c90 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.236+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f664c0cb0e0 con 0x7f664c155c90 2024-04-26T17:58:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.236+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6640032e40 con 0x7f664c155c90 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.236+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f664c1f4c00 con 0x7f664c155c90 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.237+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f664c076d20 con 0x7f664c155c90 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.237+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66400306f0 con 0x7f664c155c90 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.238+0000 7f6648ff9640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 0x7f663806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.238+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f66400aca10 con 0x7f664c155c90 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.238+0000 7f664bfff640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 0x7f663806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.238+0000 7f664bfff640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 0x7f663806ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f663c006fd0 tx=0x7f663c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.241 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.242+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f664007a540 con 0x7f664c155c90 2024-04-26T17:58:45.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.471+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f664c0cb6d0 con 0x7f664c155c90 2024-04-26T17:58:45.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.471+0000 7f6648ff9640 1 -- 172.21.15.12:0/3616571159 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f664007e840 con 0x7f664c155c90 2024-04-26T17:58:45.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:45.471 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:45.471 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 msgr2=0x7f663806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 0x7f663806ede0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f663c006fd0 tx=0x7f663c008040 comp rx=0 tx=0).stop 2024-04-26T17:58:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 msgr2=0x7f664c1f56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6640000c00 tx=0x7f66400046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 shutdown_connections 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f664c15c5b0 0x7f664c0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f664c155c90 0x7f664c1f56e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f663806c920 0x7f663806ede0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 --2- 172.21.15.12:0/3616571159 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f664c0d1cc0 0x7f664c156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 >> 172.21.15.12:0/3616571159 conn(0x7f664c074030 msgr2=0x7f664c15f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 shutdown_connections 2024-04-26T17:58:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.474+0000 7f6652396640 1 -- 172.21.15.12:0/3616571159 wait complete. 2024-04-26T17:58:45.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 Processor -- start 2024-04-26T17:58:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 -- start start 2024-04-26T17:58:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f26ac0c8370 0x7f26ac0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac073c30 0x7f26ac0cde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ac0c9230 con 0x7f26ac155fe0 2024-04-26T17:58:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f26ac15f3f0 con 0x7f26ac0c8370 2024-04-26T17:58:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.587+0000 7f26b107e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac160190 con 0x7f26ac073c30 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f26ac0c8370 0x7f26ac0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26ab59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac073c30 0x7f26ac0cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f26ac0c8370 0x7f26ac0cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:41656/0 (socket says 172.21.15.12:41656) 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 -- 172.21.15.12:0/865850032 learned_addr learned my addr 172.21.15.12:0/865850032 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 -- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac073c30 msgr2=0x7f26ac0cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 --2- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac073c30 0x7f26ac0cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 -- 172.21.15.12:0/865850032 >> v1:172.21.15.100:6789/0 conn(0x7f26ac155fe0 legacy=0x7f26ac0c9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.588+0000 7f26aa59c640 1 -- 172.21.15.12:0/865850032 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac15f6b0 con 0x7f26ac0c8370 2024-04-26T17:58:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.589+0000 7f26aa59c640 1 --2- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac0cd900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009870 tx=0x7f26a002a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dadd681d104a605f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26a9d9b640 1 -- 172.21.15.12:0/865850032 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0037070 con 0x7f26ac0c8370 2024-04-26T17:58:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26a9d9b640 1 -- 172.21.15.12:0/865850032 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a002ae50 con 0x7f26ac0c8370 2024-04-26T17:58:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26a9d9b640 1 -- 172.21.15.12:0/865850032 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a0032860 con 0x7f26ac0c8370 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 -- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 msgr2=0x7f26ac0cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 --2- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac0cd900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009870 tx=0x7f26a002a300 comp rx=0 tx=0).stop 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 -- 172.21.15.12:0/865850032 shutdown_connections 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 --2- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac0cd900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 --2- 172.21.15.12:0/865850032 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac073c30 0x7f26ac0cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.590+0000 7f26b107e640 1 -- 172.21.15.12:0/865850032 >> 172.21.15.12:0/865850032 conn(0x7f26ac0703d0 msgr2=0x7f26ac0707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.591+0000 7f26b107e640 1 -- 172.21.15.12:0/865850032 shutdown_connections 2024-04-26T17:58:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.591+0000 7f26b107e640 1 -- 172.21.15.12:0/865850032 wait complete. 2024-04-26T17:58:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.592+0000 7f26b107e640 1 Processor -- start 2024-04-26T17:58:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.592+0000 7f26b107e640 1 -- start start 2024-04-26T17:58:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac155fe0 0x7f26ac1f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac0ca140 con 0x7f26ac073c30 2024-04-26T17:58:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac15fc70 con 0x7f26ac0c8370 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26b107e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac1563c0 con 0x7f26ac155fe0 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46906/0 (socket says 172.21.15.12:46906) 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 -- 172.21.15.12:0/3964011309 learned_addr learned my addr 172.21.15.12:0/3964011309 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26ab59e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac155fe0 0x7f26ac1f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aa59c640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 -- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac155fe0 msgr2=0x7f26ac1f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac155fe0 0x7f26ac1f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 -- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 msgr2=0x7f26ac15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 -- 172.21.15.12:0/3964011309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac1e7d60 con 0x7f26ac073c30 2024-04-26T17:58:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26aad9d640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c3c0 tx=0x7f269c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.593+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0052d0 con 0x7f26ac073c30 2024-04-26T17:58:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.594+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c005490 con 0x7f26ac073c30 2024-04-26T17:58:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.594+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac0c73d0 con 0x7f26ac073c30 2024-04-26T17:58:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.594+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c007260 con 0x7f26ac073c30 2024-04-26T17:58:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.594+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac0c6740 con 0x7f26ac073c30 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.595+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac076d20 con 0x7f26ac073c30 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.595+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f269c007400 con 0x7f26ac073c30 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.595+0000 7f26937fe640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.596+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f269c08b210 con 0x7f26ac073c30 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.596+0000 7f26aa59c640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.596+0000 7f26aa59c640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 0x7f269806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26a0034000 tx=0x7f26a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.600+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f269c058d40 con 0x7f26ac073c30 2024-04-26T17:58:45.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.784+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26ac0c8cd0 con 0x7f26ac073c30 2024-04-26T17:58:45.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.786+0000 7f26937fe640 1 -- 172.21.15.12:0/3964011309 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f269c05d040 con 0x7f26ac073c30 2024-04-26T17:58:45.785 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:45.786 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:45.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 msgr2=0x7f269806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 0x7f269806edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f26a0034000 tx=0x7f26a002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:45.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 msgr2=0x7f26ac1e7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f269c00c3c0 tx=0x7f269c00c880 comp rx=0 tx=0).stop 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 shutdown_connections 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f269806c8f0 0x7f269806edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26ac155fe0 0x7f26ac1f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26ac0c8370 0x7f26ac15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 --2- 172.21.15.12:0/3964011309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26ac073c30 0x7f26ac1e7820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 >> 172.21.15.12:0/3964011309 conn(0x7f26ac0703d0 msgr2=0x7f26ac0c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 shutdown_connections 2024-04-26T17:58:45.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.788+0000 7f26b107e640 1 -- 172.21.15.12:0/3964011309 wait complete. 2024-04-26T17:58:45.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.900+0000 7f4a8eab0640 1 Processor -- start 2024-04-26T17:58:45.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.900+0000 7f4a8eab0640 1 -- start start 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8eab0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a880ca140 0x7f4a88155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8eab0640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8815bc90 con 0x7f4a88070860 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8eab0640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a8815bf70 con 0x7f4a880ca520 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8eab0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4a8815c250 con 0x7f4a880ca140 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8c84c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a880ca140 0x7f4a88155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8d04d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a88070860 0x7f4a880cbf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56532/0 (socket says 172.21.15.12:56532) 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.901+0000 7f4a8d04d640 1 -- 172.21.15.12:0/2186589629 learned_addr learned my addr 172.21.15.12:0/2186589629 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a8c84c640 1 -- 172.21.15.12:0/2186589629 >> v1:172.21.15.100:6789/0 conn(0x7f4a880ca520 legacy=0x7f4a88070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a8c84c640 1 -- 172.21.15.12:0/2186589629 >> v1:172.21.15.12:6789/0 conn(0x7f4a88070860 legacy=0x7f4a880cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a8c84c640 1 -- 172.21.15.12:0/2186589629 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8815c530 con 0x7f4a880ca140 2024-04-26T17:58:45.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a877fe640 1 -- 172.21.15.12:0/2186589629 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287811685 0 0) 0x7f4a8815bc90 con 0x7f4a88070860 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a8c84c640 1 --2- 172.21.15.12:0/2186589629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a880ca140 0x7f4a88155920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009d90 tx=0x7f4a8002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d772c6068285fedd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a877fe640 1 -- 172.21.15.12:0/2186589629 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80007740 con 0x7f4a880ca140 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a877fe640 1 -- 172.21.15.12:0/2186589629 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a800078e0 con 0x7f4a880ca140 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.902+0000 7f4a877fe640 1 -- 172.21.15.12:0/2186589629 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80007cb0 con 0x7f4a880ca140 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 -- 172.21.15.12:0/2186589629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a880ca140 msgr2=0x7f4a88155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/2186589629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a880ca140 0x7f4a88155920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009d90 tx=0x7f4a8002a6f0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 -- 172.21.15.12:0/2186589629 shutdown_connections 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/2186589629 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a880ca140 0x7f4a88155920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 -- 172.21.15.12:0/2186589629 >> 172.21.15.12:0/2186589629 conn(0x7f4a88071ec0 msgr2=0x7f4a880722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 -- 172.21.15.12:0/2186589629 shutdown_connections 2024-04-26T17:58:45.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.903+0000 7f4a8eab0640 1 -- 172.21.15.12:0/2186589629 wait complete. 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.904+0000 7f4a8eab0640 1 Processor -- start 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.904+0000 7f4a8eab0640 1 -- start start 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a880ca140 0x7f4a880cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 0x7f4a880cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a88155e60 con 0x7f4a88070860 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a880716a0 con 0x7f4a880ca520 2024-04-26T17:58:45.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8eab0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4a88155fe0 con 0x7f4a880ca140 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8c84c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8c84c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46928/0 (socket says 172.21.15.12:46928) 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8c84c640 1 -- 172.21.15.12:0/1706784229 learned_addr learned my addr 172.21.15.12:0/1706784229 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a87fff640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a880ca140 0x7f4a880cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8d04d640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 0x7f4a880cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.905+0000 7f4a8c84c640 1 -- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a880ca140 msgr2=0x7f4a880cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8c84c640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a880ca140 0x7f4a880cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8c84c640 1 -- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 msgr2=0x7f4a880cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8c84c640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 0x7f4a880cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8c84c640 1 -- 172.21.15.12:0/1706784229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a881f1900 con 0x7f4a88070860 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8d04d640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 0x7f4a880cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8c84c640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009eb0 tx=0x7f4a80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80040070 con 0x7f4a88070860 2024-04-26T17:58:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a80031d00 con 0x7f4a88070860 2024-04-26T17:58:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80045660 con 0x7f4a88070860 2024-04-26T17:58:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a880ceee0 con 0x7f4a88070860 2024-04-26T17:58:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.906+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a880cf4a0 con 0x7f4a88070860 2024-04-26T17:58:45.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.907+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a88076d20 con 0x7f4a88070860 2024-04-26T17:58:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.907+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a80039040 con 0x7f4a88070860 2024-04-26T17:58:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.908+0000 7f4a857fa640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 0x7f4a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.908+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4a800ad8b0 con 0x7f4a88070860 2024-04-26T17:58:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.908+0000 7f4a87fff640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 0x7f4a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:45.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.909+0000 7f4a87fff640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 0x7f4a7406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806dec0 tx=0x7f4a7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:45.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:45.912+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a8007bab0 con 0x7f4a88070860 2024-04-26T17:58:46.134 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.135+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a88071480 con 0x7f4a88070860 2024-04-26T17:58:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.135+0000 7f4a857fa640 1 -- 172.21.15.12:0/1706784229 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f4a800abe20 con 0x7f4a88070860 2024-04-26T17:58:46.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:46.135 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 msgr2=0x7f4a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 0x7f4a7406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806dec0 tx=0x7f4a7c009040 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 msgr2=0x7f4a880cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4a80009eb0 tx=0x7f4a80004a40 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 shutdown_connections 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a880ca520 0x7f4a880cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a7406c8f0 0x7f4a7406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a880ca140 0x7f4a880cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 --2- 172.21.15.12:0/1706784229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a88070860 0x7f4a880cf9c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 >> 172.21.15.12:0/1706784229 conn(0x7f4a88071ec0 msgr2=0x7f4a8815a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.137+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 shutdown_connections 2024-04-26T17:58:46.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.138+0000 7f4a8eab0640 1 -- 172.21.15.12:0/1706784229 wait complete. 2024-04-26T17:58:46.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:12.845520+0000', 'modified': '2024-04-26T17:58:37.922040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3743641599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3743641599}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3743641599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-04-26T17:58:46.752 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:46.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T17:58:46.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.860+0000 7f7adb093640 1 Processor -- start 2024-04-26T17:58:46.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 -- start start 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ad4155f70 0x7f7ad415f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 0x7f7ad4166480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad415f190 con 0x7f7ad40c6530 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad40cc1c0 con 0x7f7ad4155f70 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7adb093640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad415f4c0 con 0x7f7ad40cdc90 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7ad8e2f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ad4155f70 0x7f7ad415f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7ad3fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7ad40c6530 0x7f7ad40cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56536/0 (socket says 172.21.15.12:56536) 2024-04-26T17:58:46.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.861+0000 7f7ad3fff640 1 -- 172.21.15.12:0/3262732352 learned_addr learned my addr 172.21.15.12:0/3262732352 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 0x7f7ad4166480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3262732352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 msgr2=0x7f7ad4166480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 0x7f7ad4166480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3262732352 >> v1:172.21.15.12:6789/0 conn(0x7f7ad40c6530 legacy=0x7f7ad40cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3262732352 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad415c970 con 0x7f7ad4155f70 2024-04-26T17:58:46.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 0x7f7ad4166480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.862+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4155f70 0x7f7ad415f950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097a0 tx=0x7f7ac802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff31586004a29ef server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7ad37fe640 1 -- 172.21.15.12:0/3262732352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8037070 con 0x7f7ad4155f70 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7ad37fe640 1 -- 172.21.15.12:0/3262732352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac8032440 con 0x7f7ad4155f70 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7ad37fe640 1 -- 172.21.15.12:0/3262732352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8032810 con 0x7f7ad4155f70 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 -- 172.21.15.12:0/3262732352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4155f70 msgr2=0x7f7ad415f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4155f70 0x7f7ad415f950 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80097a0 tx=0x7f7ac802a210 comp rx=0 tx=0).stop 2024-04-26T17:58:46.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 -- 172.21.15.12:0/3262732352 shutdown_connections 2024-04-26T17:58:46.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad40cdc90 0x7f7ad4166480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 --2- 172.21.15.12:0/3262732352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4155f70 0x7f7ad415f950 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 -- 172.21.15.12:0/3262732352 >> 172.21.15.12:0/3262732352 conn(0x7f7ad4074500 msgr2=0x7f7ad4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 -- 172.21.15.12:0/3262732352 shutdown_connections 2024-04-26T17:58:46.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.863+0000 7f7adb093640 1 -- 172.21.15.12:0/3262732352 wait complete. 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.864+0000 7f7adb093640 1 Processor -- start 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 -- start start 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad40cdc90 0x7f7ad41522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad4155f70 0x7f7ad4152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad40c6a80 con 0x7f7ad40c6530 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad40cc6f0 con 0x7f7ad40cdc90 2024-04-26T17:58:46.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7adb093640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad40ce5b0 con 0x7f7ad4155f70 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.865+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46952/0 (socket says 172.21.15.12:46952) 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/2247765290 learned_addr learned my addr 172.21.15.12:0/2247765290 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad9630640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad4155f70 0x7f7ad4152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad40cdc90 0x7f7ad41522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad4155f70 msgr2=0x7f7ad4152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad4155f70 0x7f7ad4152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad40cdc90 msgr2=0x7f7ad41522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad40cdc90 0x7f7ad41522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/2247765290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad40b6f60 con 0x7f7ad40c6530 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8035040 tx=0x7f7ac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad17fa640 1 -- 172.21.15.12:0/2247765290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8037040 con 0x7f7ad40c6530 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad17fa640 1 -- 172.21.15.12:0/2247765290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac8030770 con 0x7f7ad40c6530 2024-04-26T17:58:46.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad41f5c30 con 0x7f7ad40c6530 2024-04-26T17:58:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7ad17fa640 1 -- 172.21.15.12:0/2247765290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8030b80 con 0x7f7ad40c6530 2024-04-26T17:58:46.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.866+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad415eea0 con 0x7f7ad40c6530 2024-04-26T17:58:46.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.868+0000 7f7ad17fa640 1 -- 172.21.15.12:0/2247765290 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ac8044020 con 0x7f7ad40c6530 2024-04-26T17:58:46.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.868+0000 7f7ad17fa640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 0x7f7ab806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.868+0000 7f7ad17fa640 1 -- 172.21.15.12:0/2247765290 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ac80ac3e0 con 0x7f7ad40c6530 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.868+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 0x7f7ab806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.869+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 0x7f7ab806ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4155010 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.869+0000 7f7adddaa740 1 Processor -- start 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.869+0000 7f7adddaa740 1 -- start start 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 0x55796164f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 0x557961608a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55796156f740 con 0x557961608f70 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55796150b3a0 con 0x557961606b20 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55796156b700 con 0x557961633f90 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46954/0 (socket says 172.21.15.12:46954) 2024-04-26T17:58:46.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 -- 172.21.15.12:0/3045874168 learned_addr learned my addr 172.21.15.12:0/3045874168 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 0x557961608a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 0x55796164f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 -- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 msgr2=0x55796164f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 0x55796164f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 -- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 msgr2=0x557961608a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 0x557961608a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad9630640 1 -- 172.21.15.12:0/3045874168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557961527750 con 0x557961608f70 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 0x55796164f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.870+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 0x557961608a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d460 tx=0x7f7acc00d920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35f3445b148057b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7abe7fc640 1 -- 172.21.15.12:0/3045874168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc01a070 con 0x557961608f70 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7abe7fc640 1 -- 172.21.15.12:0/3045874168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc00b740 con 0x557961608f70 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7abe7fc640 1 -- 172.21.15.12:0/3045874168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00bb30 con 0x557961608f70 2024-04-26T17:58:46.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 -- 172.21.15.12:0/3045874168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 msgr2=0x557961634370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00d460 tx=0x7f7acc00d920 comp rx=0 tx=0).stop 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 -- 172.21.15.12:0/3045874168 shutdown_connections 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961608f70 0x557961634370 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961606b20 0x557961608a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3045874168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961633f90 0x55796164f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 -- 172.21.15.12:0/3045874168 >> 172.21.15.12:0/3045874168 conn(0x5579616079b0 msgr2=0x55796164ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 -- 172.21.15.12:0/3045874168 shutdown_connections 2024-04-26T17:58:46.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.871+0000 7f7adddaa740 1 -- 172.21.15.12:0/3045874168 wait complete. 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.872+0000 7f7adddaa740 1 -- start start 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.872+0000 7f7adddaa740 1 Processor -- start 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x5579616480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x557961632680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x557961606fb0 con 0x557961633f90 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5579614f6fe0 con 0x55796165c5b0 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55796160d090 con 0x557961631c80 2024-04-26T17:58:46.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7adddaa740 10 client.0 _ll_register_callbacks cb 0x55796150d150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46958/0 (socket says 172.21.15.12:46958) 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3362869459 learned_addr learned my addr 172.21.15.12:0/3362869459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x5579616480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad9630640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x557961632680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 msgr2=0x5579616480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x5579616480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 msgr2=0x557961632680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x557961632680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/3362869459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579612812d0 con 0x557961633f90 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.873+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac807a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3e54323b34920 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80829b0 con 0x557961633f90 2024-04-26T17:58:46.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ac8030d20 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7acc00b740 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7ac8076440 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 10 client.4722 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55796134b6b0 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc00b740 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7ac803a030 con 0x557961633f90 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 10 client.4722 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 10 client.4722 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 20 client.4722 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55796165f380 0x55796166abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 4 client.4722 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55796157d350 con 0x55796165f380 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.874+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55796165f380 0x55796166abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.875+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55796165f380 0x55796166abe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd994534bcbbf696 server_cookie=670e5e3fa4636ecf in_seq=0 out_seq=0 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.875+0000 7f7ab37fe640 10 client.4722 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:46.879 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.875+0000 7f7ab37fe640 1 -- 172.21.15.12:0/3362869459 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55796157d350 con 0x55796165f380 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.875+0000 7f7ab37fe640 10 client.4722 handle_command_reply: tid=0 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.875+0000 7f7adddaa740 1 client.4722 shutdown 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 msgr2=0x55796164fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8000c00 tx=0x7f7ac807a610 comp rx=0 tx=0).stop 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 shutdown_connections 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55796165f380 0x55796166abe0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x557961632680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x5579616480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7ab37fe640 0 client.4722 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 --2- 172.21.15.12:0/3362869459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x55796164fa20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 >> 172.21.15.12:0/3362869459 conn(0x557961608f70 msgr2=0x557961604670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 shutdown_connections 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 1 -- 172.21.15.12:0/3362869459 wait complete. 2024-04-26T17:58:46.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.876+0000 7f7adddaa740 20 client.4722 trim_cache size 0 max 16384 2024-04-26T17:58:46.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.894+0000 7f7adddaa740 1 Processor -- start 2024-04-26T17:58:46.894 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.894+0000 7f7adddaa740 1 -- start start 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961633f90 0x55796166fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55796165c5b0 0x557961670150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41fe410 con 0x557961631c80 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5579616475f0 con 0x557961633f90 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55796165ca30 con 0x55796165c5b0 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7ad8e2f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46972/0 (socket says 172.21.15.12:46972) 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/1911030932 learned_addr learned my addr 172.21.15.12:0/1911030932 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961633f90 0x55796166fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.895+0000 7f7ad9630640 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55796165c5b0 0x557961670150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55796165c5b0 msgr2=0x557961670150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55796165c5b0 0x557961670150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961633f90 msgr2=0x55796166fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961633f90 0x55796166fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 -- 172.21.15.12:0/1911030932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579616478d0 con 0x557961631c80 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80761e0 tx=0x7f7ac807c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5b21ed0ab78700 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7abdffb640 1 -- 172.21.15.12:0/1911030932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac80829b0 con 0x557961631c80 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7abdffb640 1 -- 172.21.15.12:0/1911030932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac80780d0 con 0x557961631c80 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7abdffb640 1 -- 172.21.15.12:0/1911030932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8030d20 con 0x557961631c80 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 -- 172.21.15.12:0/1911030932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 msgr2=0x557961634560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80761e0 tx=0x7f7ac807c000 comp rx=0 tx=0).stop 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 -- 172.21.15.12:0/1911030932 shutdown_connections 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55796165c5b0 0x557961670150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x557961633f90 0x55796166fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1911030932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961631c80 0x557961634560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.896+0000 7f7adddaa740 1 -- 172.21.15.12:0/1911030932 >> 172.21.15.12:0/1911030932 conn(0x557961608f70 msgr2=0x55796160ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.897+0000 7f7adddaa740 1 -- 172.21.15.12:0/1911030932 shutdown_connections 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.897+0000 7f7adddaa740 1 -- 172.21.15.12:0/1911030932 wait complete. 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.897+0000 7f7adddaa740 1 -- start start 2024-04-26T17:58:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.897+0000 7f7adddaa740 1 Processor -- start 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x55796164b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x5579616c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55796165f200 con 0x557961633f90 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55796165cfa0 con 0x55796165c5b0 2024-04-26T17:58:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55796165f890 con 0x557961631c80 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7adddaa740 10 client.0 _ll_register_callbacks cb 0x7f7ac8079730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46974/0 (socket says 172.21.15.12:46974) 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 -- 172.21.15.12:0/1213119326 learned_addr learned my addr 172.21.15.12:0/1213119326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x55796164b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad9630640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x5579616c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 -- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 msgr2=0x55796164b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x55796164b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 -- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 msgr2=0x5579616c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x5579616c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad3fff640 1 -- 172.21.15.12:0/1213119326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557961604fb0 con 0x557961633f90 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.898+0000 7f7ad9630640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x5579616c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ad3fff640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0001eb0 tx=0x7f7ac0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f24f015e7cbf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0007520 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7ac001d030 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac80780d0 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f7ac00076c0 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 10 client.4728 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55796164bee0 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac80780d0 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f7ac002f460 con 0x557961633f90 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 10 client.4728 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 10 client.4728 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 20 client.4728 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5579616cae70 0x5579616d39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 4 client.4728 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:46.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.899+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "status"}) -- 0x557961608d60 con 0x5579616cae70 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5579616cae70 0x5579616d39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7ab37fe640 10 client.4728 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7ad8e2f640 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5579616cae70 0x5579616d39a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14cb7c1923530135 server_cookie=a436b4d1765a2eb1 in_seq=0 out_seq=0 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7ab37fe640 1 -- 172.21.15.12:0/1213119326 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557961608d60 con 0x5579616cae70 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7ab37fe640 10 client.4728 handle_command_reply: tid=0 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7adddaa740 1 client.4728 shutdown 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 msgr2=0x5579616c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.900+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0001eb0 tx=0x7f7ac0000bc0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 shutdown_connections 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5579616cae70 0x5579616d39a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55796165c5b0 0x5579616c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x557961633f90 0x5579616c7b70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7ab37fe640 0 client.4728 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 --2- 172.21.15.12:0/1213119326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557961631c80 0x55796164b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 >> 172.21.15.12:0/1213119326 conn(0x557961608f70 msgr2=0x557961634560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 shutdown_connections 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 1 -- 172.21.15.12:0/1213119326 wait complete. 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adddaa740 20 client.4728 trim_cache size 0 max 16384 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "68faa4ec-4899-41e7-bbbd-182baff15e13", 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4300, 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-04-26T17:58:46.906 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 33.421578797000002, 2024-04-26T17:58:46.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 9, 2024-04-26T17:58:46.907 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:46.907 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:46.907 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 39.454756908999997 2024-04-26T17:58:46.907 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 msgr2=0x7f7ab806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 0x7f7ab806ede0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4155010 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 msgr2=0x7f7ad41f5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8035040 tx=0x7f7ac80046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 shutdown_connections 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7ab806c920 0x7f7ab806ede0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7ad4155f70 0x7f7ad4152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ad40cdc90 0x7f7ad41522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 --2- 172.21.15.12:0/2247765290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad40c6530 0x7f7ad41f5300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 >> 172.21.15.12:0/2247765290 conn(0x7f7ad4074500 msgr2=0x7f7ad4150830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 shutdown_connections 2024-04-26T17:58:46.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:46.901+0000 7f7adb093640 1 -- 172.21.15.12:0/2247765290 wait complete. 2024-04-26T17:58:46.911 INFO:teuthology.run_tasks:Running task sequential... 2024-04-26T17:58:46.920 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-26T17:58:46.920 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-26T17:58:46.920 INFO:teuthology.task.print:Enabling mgr modules 2024-04-26T17:58:46.921 INFO:teuthology.run_tasks:Running task kclient... 2024-04-26T17:58:46.932 INFO:tasks.kclient:Mounting kernel clients... 2024-04-26T17:58:46.932 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-26T17:58:46.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:46.933 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-04-26T17:58:46.948 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-26T17:58:46.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:46.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-26T17:58:47.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-04-26T17:58:47.113 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-26T17:58:47.113 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-26T17:58:47.113 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:47.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-26T17:58:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.217+0000 7f0199ebd640 1 Processor -- start 2024-04-26T17:58:47.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.217+0000 7f0199ebd640 1 -- start start 2024-04-26T17:58:47.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0199ebd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f01940c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0199ebd640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01940c7d30 con 0x7f019406e240 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0199ebd640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01940c7ff0 con 0x7f0194153b10 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0199ebd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f019406e8d0 con 0x7f019415d570 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0192ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f019406e240 0x7f019415ce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56550/0 (socket says 172.21.15.12:56550) 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0192ffd640 1 -- 172.21.15.12:0/3995019840 learned_addr learned my addr 172.21.15.12:0/3995019840 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 372725002 0 0) 0x7f01940c7d30 con 0x7f019406e240 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f0193fff640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f01940c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017c003520 con 0x7f019406e240 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1850017827 0 0) 0x7f017c003520 con 0x7f019406e240 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 msgr2=0x7f01940c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f01940c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 >> v1:172.21.15.100:6789/0 conn(0x7f0194153b10 legacy=0x7f01940cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.220 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0194072fe0 con 0x7f019406e240 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f0184001670 con 0x7f019406e240 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 >> v1:172.21.15.12:6789/0 conn(0x7f019406e240 legacy=0x7f019415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f017c0039e0 0x7f017c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f017c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017c004d40 0x7f017c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f017c00bb00 con 0x7f017c004d40 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f017c00bc80 con 0x7f017c0039e0 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.218+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f017c00be80 con 0x7f019415d570 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f017c0039e0 0x7f017c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f0192ffd640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f017c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f0193fff640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017c004d40 0x7f017c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 -- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 msgr2=0x7f017c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f017c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 -- 172.21.15.12:0/3995019840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017c004d40 msgr2=0x7f017c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017c004d40 0x7f017c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f01937fe640 1 -- 172.21.15.12:0/3995019840 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c003520 con 0x7f017c0039e0 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f0192ffd640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f019415d570 0x7f017c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.219+0000 7f0193fff640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f017c004d40 0x7f017c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f01937fe640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f017c0039e0 0x7f017c003e00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0188001720 tx=0x7f017c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef5751c8de41ffb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0188001370 con 0x7f017c0039e0 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01880052d0 con 0x7f017c0039e0 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f01927fc640 1 -- 172.21.15.12:0/3995019840 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018802abc0 con 0x7f017c0039e0 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 -- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f017c0039e0 msgr2=0x7f017c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 --2- 172.21.15.12:0/3995019840 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f017c0039e0 0x7f017c003e00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0188001720 tx=0x7f017c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0193fff640 1 -- 172.21.15.12:0/3995019840 reap_dead start 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 -- 172.21.15.12:0/3995019840 shutdown_connections 2024-04-26T17:58:47.222 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 -- 172.21.15.12:0/3995019840 >> 172.21.15.12:0/3995019840 conn(0x7f0194068270 msgr2=0x7f0194068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 -- 172.21.15.12:0/3995019840 shutdown_connections 2024-04-26T17:58:47.223 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.220+0000 7f0199ebd640 1 -- 172.21.15.12:0/3995019840 wait complete. 2024-04-26T17:58:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.221+0000 7f0199ebd640 1 Processor -- start 2024-04-26T17:58:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 -- start start 2024-04-26T17:58:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 0x7f0194150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0194157d90 0x7f01941592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.225 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f01940735a0 con 0x7f01941597f0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0194073910 con 0x7f0194157d90 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0199ebd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0194153ef0 con 0x7f017c0039e0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0193fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0193fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47002/0 (socket says 172.21.15.12:47002) 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.222+0000 7f0193fff640 1 -- 172.21.15.12:0/240376713 learned_addr learned my addr 172.21.15.12:0/240376713 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f01937fe640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 0x7f0194150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0192ffd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0194157d90 0x7f01941592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 -- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 msgr2=0x7f0194150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 0x7f0194150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 -- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0194157d90 msgr2=0x7f01941592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0194157d90 0x7f01941592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 -- 172.21.15.12:0/240376713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01941582f0 con 0x7f01941597f0 2024-04-26T17:58:47.226 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f01937fe640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 0x7f0194150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0193fff640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f01940cad90 tx=0x7f018c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c009c10 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c003990 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184007d30 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01941efc80 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.223+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941f0240 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.224+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0194076d20 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.225+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f018c015430 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.225+0000 7f017bfff640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 0x7f018006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.225+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f018c08c5d0 con 0x7f01941597f0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.225+0000 7f01937fe640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 0x7f018006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:47.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.226+0000 7f01937fe640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 0x7f018006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0188032000 tx=0x7f018802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:47.228 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.229+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f018c019030 con 0x7f01941597f0 2024-04-26T17:58:47.454 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.455+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f019406eab0 con 0x7f01941597f0 2024-04-26T17:58:47.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.455+0000 7f017bfff640 1 -- 172.21.15.12:0/240376713 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f018c010040 con 0x7f01941597f0 2024-04-26T17:58:47.455 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 msgr2=0x7f018006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 0x7f018006ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0188032000 tx=0x7f018802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 msgr2=0x7f0194145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f01940cad90 tx=0x7f018c00f580 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 shutdown_connections 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01941597f0 0x7f0194145ae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0194157d90 0x7f01941592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f018006c920 0x7f018006ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 --2- 172.21.15.12:0/240376713 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f017c0039e0 0x7f0194150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:47.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 >> 172.21.15.12:0/240376713 conn(0x7f0194068270 msgr2=0x7f019414f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:47.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 shutdown_connections 2024-04-26T17:58:47.458 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47.457+0000 7f0199ebd640 1 -- 172.21.15.12:0/240376713 wait complete. 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-26T17:58:47.468 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-26T17:58:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.469 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2024-04-26T17:58:47.484 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-26T17:58:47.484 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-26T17:58:47.484 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2024-04-26T17:58:47.484 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:47.484 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-26T17:58:47.485 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42674sec preferred_lft 42674sec 2024-04-26T17:58:47.486 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2024-04-26T17:58:47.486 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2024-04-26T17:58:47.486 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-26T17:58:47.486 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2024-04-26T17:58:47.486 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2024-04-26T17:58:47.486 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-26T17:58:47.486 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-26T17:58:47.487 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:47.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:47.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:47.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.623 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-26T17:58:47.646 INFO:teuthology.orchestra.run.smithi012.stdout:1 2024-04-26T17:58:47.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.648 DEBUG:teuthology.orchestra.run.smithi012:> route 2024-04-26T17:58:47.704 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2024-04-26T17:58:47.704 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-26T17:58:47.704 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-26T17:58:47.705 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-26T17:58:47.705 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-26T17:58:47.705 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:47.793 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:47.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:47.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.831 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-04-26T17:58:47.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:47.846 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2024-04-26T17:58:47.901 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:47.901 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:47.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T17:58:47.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-26T17:58:47.901 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:47.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:48.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:48.017 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-26T17:58:48.018 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:48.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:48.476 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-26T17:58:48.476 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2024-04-26T17:58:48.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2024-04-26T17:58:48.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2024-04-26T17:58:48.476 DEBUG:teuthology.orchestra.run.smithi012:> ') 2024-04-26T17:58:48.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:48.550 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:48.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:48.556 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:48.571 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-26T17:58:48.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-26T17:58:48.571 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:48.627 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-26T17:58:48.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:48.627 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:48.709 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:48.710 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T17:58:48.817 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-26T17:58:48.817 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-26T17:58:48.817 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.100:3300,172.21.15.100:3301" 2024-04-26T17:58:48.817 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@68faa4ec-4899-41e7-bbbd-182baff15e13.cephfs=/ 2024-04-26T17:58:48.817 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.100:3300/172.21.15.100:3301" will pass to kernel 2024-04-26T17:58:48.818 INFO:teuthology.orchestra.run.smithi012.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-26T17:58:48.818 INFO:teuthology.orchestra.run.smithi012.stdout: You just mounted a file system that supports labels which does not 2024-04-26T17:58:48.818 INFO:teuthology.orchestra.run.smithi012.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-26T17:58:48.818 INFO:teuthology.orchestra.run.smithi012.stdout: applications will generate AVC messages and not be allowed access to 2024-04-26T17:58:48.818 INFO:teuthology.orchestra.run.smithi012.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-26T17:58:48.819 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-26T17:58:48.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T17:58:48.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:48.883 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:48.981 INFO:teuthology.orchestra.run.smithi012.stdout:client4636 2024-04-26T17:58:48.981 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T17:58:48.982 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T17:58:48.997 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:49.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:49.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:49.094 INFO:teuthology.orchestra.run.smithi012.stdout:client4636 2024-04-26T17:58:49.095 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-26T17:58:49.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-26T17:58:49.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:49.151 INFO:teuthology.orchestra.run.smithi012.stdout:client4636 2024-04-26T17:58:49.151 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/68faa4ec-4899-41e7-bbbd-182baff15e13.client4636/status') 2024-04-26T17:58:49.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-26T17:58:49.210 INFO:teuthology.orchestra.run.smithi012.stdout:instance: client.4636 (3)172.21.15.12:0/1827043504 2024-04-26T17:58:49.210 INFO:teuthology.orchestra.run.smithi012.stdout:blocklisted: false 2024-04-26T17:58:49.211 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records in 2024-04-26T17:58:49.211 INFO:teuthology.orchestra.run.smithi012.stderr:0+1 records out 2024-04-26T17:58:49.211 INFO:teuthology.orchestra.run.smithi012.stderr:70 bytes copied, 2.3754e-05 s, 2.9 MB/s 2024-04-26T17:58:49.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-26T17:58:49.218 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-26T17:58:49.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T17:58:49.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 Processor -- start 2024-04-26T17:58:49.337 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 -- start start 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 0x7f56d00ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56d00738c0 con 0x7f56d00b5970 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f56d0160160 con 0x7f56d00ce100 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.338+0000 7f56d6589640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f56d00729d0 con 0x7f56d00cc4f0 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cffff640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 0x7f56d00ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:48534/0 (socket says 172.21.15.12:48534) 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3322026688 learned_addr learned my addr 172.21.15.12:0/3322026688 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3322026688 >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 msgr2=0x7f56d00ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:49.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/3322026688 >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 0x7f56d00ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3322026688 >> v1:172.21.15.100:6789/0 conn(0x7f56d00b5970 legacy=0x7f56d00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cf7fe640 1 -- 172.21.15.12:0/3322026688 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d0072cb0 con 0x7f56d00cc4f0 2024-04-26T17:58:49.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.339+0000 7f56cffff640 1 --2- 172.21.15.12:0/3322026688 >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 0x7f56d00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.340+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/3322026688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009870 tx=0x7f56c402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3a60d56870a031 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.340+0000 7f56ceffd640 1 -- 172.21.15.12:0/3322026688 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4037070 con 0x7f56d00cc4f0 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.340+0000 7f56ceffd640 1 -- 172.21.15.12:0/3322026688 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c4032440 con 0x7f56d00cc4f0 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.340+0000 7f56ceffd640 1 -- 172.21.15.12:0/3322026688 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c4032810 con 0x7f56d00cc4f0 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 -- 172.21.15.12:0/3322026688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 msgr2=0x7f56d015fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 --2- 172.21.15.12:0/3322026688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56c4009870 tx=0x7f56c402a1c0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 -- 172.21.15.12:0/3322026688 shutdown_connections 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 --2- 172.21.15.12:0/3322026688 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d015fc20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 --2- 172.21.15.12:0/3322026688 >> v2:172.21.15.100:3300/0 conn(0x7f56d00ce100 0x7f56d00ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 -- 172.21.15.12:0/3322026688 >> 172.21.15.12:0/3322026688 conn(0x7f56d0068270 msgr2=0x7f56d0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 -- 172.21.15.12:0/3322026688 shutdown_connections 2024-04-26T17:58:49.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.341+0000 7f56d6589640 1 -- 172.21.15.12:0/3322026688 wait complete. 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.342+0000 7f56d6589640 1 Processor -- start 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.342+0000 7f56d6589640 1 -- start start 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d00caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56d00ce100 0x7f56d01f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f56d0073550 con 0x7f56d00b5970 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f56d0073270 con 0x7f56d00ce100 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d6589640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f56d0156360 con 0x7f56d00cc4f0 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47016/0 (socket says 172.21.15.12:47016) 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 -- 172.21.15.12:0/1942007773 learned_addr learned my addr 172.21.15.12:0/1942007773 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56d4b26640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56d00ce100 0x7f56d01f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d00caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 -- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 msgr2=0x7f56d00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d00caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 -- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56d00ce100 msgr2=0x7f56d01f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56d00ce100 0x7f56d01f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 -- 172.21.15.12:0/1942007773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d01f2bf0 con 0x7f56d00b5970 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.343+0000 7f56cffff640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f56c000e990 tx=0x7f56c000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.344+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c0017070 con 0x7f56d00b5970 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.344+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56c000c9e0 con 0x7f56d00b5970 2024-04-26T17:58:49.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.344+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c000cdb0 con 0x7f56d00b5970 2024-04-26T17:58:49.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.344+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d00d2160 con 0x7f56d00b5970 2024-04-26T17:58:49.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.344+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d00d18c0 con 0x7f56d00b5970 2024-04-26T17:58:49.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.345+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d008e2b0 con 0x7f56d00b5970 2024-04-26T17:58:49.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.345+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56c001a070 con 0x7f56d00b5970 2024-04-26T17:58:49.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.345+0000 7f56ccff9640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 0x7f56bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.346+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f56c008bd20 con 0x7f56d00b5970 2024-04-26T17:58:49.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.346+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 0x7f56bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.346+0000 7f56cf7fe640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 0x7f56bc06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56c4034000 tx=0x7f56c402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.350+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f56d008e2b0 con 0x7f56d00b5970 2024-04-26T17:58:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.531+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f56d0076d20 con 0x7f56bc06c920 2024-04-26T17:58:49.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.541+0000 7f56ccff9640 1 -- 172.21.15.12:0/1942007773 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f56d0076d20 con 0x7f56bc06c920 2024-04-26T17:58:49.544 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:49.546 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:49.547 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 msgr2=0x7f56bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 0x7f56bc06ede0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f56c4034000 tx=0x7f56c402e000 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 msgr2=0x7f56d01f26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f56c000e990 tx=0x7f56c000ee50 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 shutdown_connections 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56d00ce100 0x7f56d01f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f56bc06c920 0x7f56bc06ede0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56d00cc4f0 0x7f56d00caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 --2- 172.21.15.12:0/1942007773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f56d00b5970 0x7f56d01f26b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 >> 172.21.15.12:0/1942007773 conn(0x7f56d0068270 msgr2=0x7f56d00b5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 shutdown_connections 2024-04-26T17:58:49.548 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.544+0000 7f56d6589640 1 -- 172.21.15.12:0/1942007773 wait complete. 2024-04-26T17:58:49.554 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-26T17:58:47.882595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002875"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:49.560 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:49.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.696+0000 7fb65c41d640 1 Processor -- start 2024-04-26T17:58:49.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.696+0000 7fb65c41d640 1 -- start start 2024-04-26T17:58:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65c41d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb6540cc4f0 0x7fb6540ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65c41d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb6540b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65c41d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6540738c0 con 0x7fb6540ce100 2024-04-26T17:58:49.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65c41d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb6540b6310 con 0x7fb6540cc4f0 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65c41d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb6540729d0 con 0x7fb6540b5970 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65a1b9640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb6540ce100 0x7fb65415fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56566/0 (socket says 172.21.15.12:56566) 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65a1b9640 1 -- 172.21.15.12:0/411081878 learned_addr learned my addr 172.21.15.12:0/411081878 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb6599b8640 1 --2- 172.21.15.12:0/411081878 >> v2:172.21.15.100:3300/0 conn(0x7fb6540cc4f0 0x7fb6540ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.697+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb6540b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2596707093 0 0) 0x7fb6540738c0 con 0x7fb6540ce100 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb63c003520 con 0x7fb6540ce100 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2781599780 0 0) 0x7fb63c003520 con 0x7fb6540ce100 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 msgr2=0x7fb6540b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb6540b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 >> v2:172.21.15.100:3300/0 conn(0x7fb6540cc4f0 msgr2=0x7fb6540ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 --2- 172.21.15.12:0/411081878 >> v2:172.21.15.100:3300/0 conn(0x7fb6540cc4f0 0x7fb6540ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb654072cb0 con 0x7fb6540ce100 2024-04-26T17:58:49.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fb64c001670 con 0x7fb6540ce100 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6599b8640 1 --2- 172.21.15.12:0/411081878 >> v2:172.21.15.100:3300/0 conn(0x7fb6540cc4f0 0x7fb6540ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 >> v1:172.21.15.12:6789/0 conn(0x7fb6540ce100 legacy=0x7fb65415fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb63c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c003f30 0x7fb63c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb63c004d40 0x7fb63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540b6310 con 0x7fb63c004d40 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540729d0 con 0x7fb63c003f30 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb63c00ba10 con 0x7fb6540b5970 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a1b9640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb63c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb63c004d40 0x7fb63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb6599b8640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c003f30 0x7fb63c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 -- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 msgr2=0x7fb63c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6540b5970 0x7fb63c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 -- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c003f30 msgr2=0x7fb63c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c003f30 0x7fb63c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.698+0000 7fb65a9ba640 1 -- 172.21.15.12:0/411081878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63c003520 con 0x7fb63c004d40 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.699+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb63c004d40 0x7fb63c0051c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e170 tx=0x7fb63c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecd73df29b2628c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.699+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644034020 con 0x7fb63c004d40 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.699+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6440305f0 con 0x7fb63c004d40 2024-04-26T17:58:49.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.699+0000 7fb6591b7640 1 -- 172.21.15.12:0/411081878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644009c10 con 0x7fb63c004d40 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 -- 172.21.15.12:0/411081878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb63c004d40 msgr2=0x7fb63c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 --2- 172.21.15.12:0/411081878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb63c004d40 0x7fb63c0051c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e170 tx=0x7fb63c005830 comp rx=0 tx=0).stop 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65a9ba640 1 -- 172.21.15.12:0/411081878 reap_dead start 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 -- 172.21.15.12:0/411081878 shutdown_connections 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 -- 172.21.15.12:0/411081878 >> 172.21.15.12:0/411081878 conn(0x7fb654068270 msgr2=0x7fb654068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 -- 172.21.15.12:0/411081878 shutdown_connections 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.700+0000 7fb65c41d640 1 -- 172.21.15.12:0/411081878 wait complete. 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.701+0000 7fb65c41d640 1 Processor -- start 2024-04-26T17:58:49.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.701+0000 7fb65c41d640 1 -- start start 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c004d40 0x7fb6541f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6541496e0 0x7fb6540ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb654073550 con 0x7fb654157b10 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb654073270 con 0x7fb63c004d40 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65c41d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb654156360 con 0x7fb6541496e0 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47028/0 (socket says 172.21.15.12:47028) 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 -- 172.21.15.12:0/3356668987 learned_addr learned my addr 172.21.15.12:0/3356668987 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb6599b8640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6541496e0 0x7fb6540ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a1b9640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c004d40 0x7fb6541f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 -- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6541496e0 msgr2=0x7fb6540ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6541496e0 0x7fb6540ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 -- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c004d40 msgr2=0x7fb6541f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c004d40 0x7fb6541f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.702+0000 7fb65a9ba640 1 -- 172.21.15.12:0/3356668987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6541567a0 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb65a9ba640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb644009f90 tx=0x7fb644009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644034040 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb644003990 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb654156a40 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644009c10 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.703+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb654157000 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.704+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb65408e2b0 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.704+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb644037020 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.705+0000 7fb652ffd640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 0x7fb64006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.705+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb6440aca20 con 0x7fb654157b10 2024-04-26T17:58:49.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.705+0000 7fb65a1b9640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 0x7fb64006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:49.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.706+0000 7fb65a1b9640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 0x7fb64006ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb64c007fd0 tx=0x7fb64c0078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:49.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.710+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb65408e2b0 con 0x7fb654157b10 2024-04-26T17:58:49.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.890+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb654076d20 con 0x7fb64006c920 2024-04-26T17:58:49.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.899+0000 7fb652ffd640 1 -- 172.21.15.12:0/3356668987 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7fb654076d20 con 0x7fb64006c920 2024-04-26T17:58:49.902 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:49.903 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 msgr2=0x7fb64006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 0x7fb64006ede0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb64c007fd0 tx=0x7fb64c0078f0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 msgr2=0x7fb654157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb644009f90 tx=0x7fb644009750 comp rx=0 tx=0).stop 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 shutdown_connections 2024-04-26T17:58:49.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb654157b10 0x7fb654157fc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb64006c920 0x7fb64006ede0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6541496e0 0x7fb6540ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 --2- 172.21.15.12:0/3356668987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb63c004d40 0x7fb6541f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 >> 172.21.15.12:0/3356668987 conn(0x7fb654068270 msgr2=0x7fb654068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 shutdown_connections 2024-04-26T17:58:49.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:49.902+0000 7fb65c41d640 1 -- 172.21.15.12:0/3356668987 wait complete. 2024-04-26T17:58:49.912 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-26T17:58:49.883193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003108"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:49.917 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T17:58:49.918 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T17:58:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.055+0000 7fcb66146640 1 Processor -- start 2024-04-26T17:58:50.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.055+0000 7fcb66146640 1 -- start start 2024-04-26T17:58:50.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb66146640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb600d1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb66146640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb600cc8d0 con 0x7fcb60156060 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb66146640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb600cec40 con 0x7fcb600cc2f0 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb66146640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcb600c68e0 con 0x7fcb600d1280 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcb60156060 0x7fcb6015c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56578/0 (socket says 172.21.15.12:56578) 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5f7fe640 1 -- 172.21.15.12:0/2153233987 learned_addr learned my addr 172.21.15.12:0/2153233987 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5ffff640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb600d1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074355256 0 0) 0x7fcb600cc8d0 con 0x7fcb60156060 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb48003520 con 0x7fcb60156060 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061402512 0 0) 0x7fcb48003520 con 0x7fcb60156060 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 msgr2=0x7fcb600d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb600d1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 >> v1:172.21.15.100:6789/0 conn(0x7fcb600cc2f0 legacy=0x7fcb600ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb600c6320 con 0x7fcb60156060 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fcb50001670 con 0x7fcb60156060 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 >> v1:172.21.15.12:6789/0 conn(0x7fcb60156060 legacy=0x7fcb6015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb480039e0 0x7fcb48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb48004800 0x7fcb48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.056+0000 7fcb5e7fc640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb48005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600c68e0 con 0x7fcb480039e0 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4800baf0 con 0x7fcb48004800 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4800bcf0 con 0x7fcb600d1280 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb480039e0 0x7fcb48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5effd640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb48004800 0x7fcb48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5ffff640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb48005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 -- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 msgr2=0x7fcb48005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb600d1280 0x7fcb48005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 -- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb48004800 msgr2=0x7fcb48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb48004800 0x7fcb48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.057+0000 7fcb5f7fe640 1 -- 172.21.15.12:0/2153233987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48003520 con 0x7fcb480039e0 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb480039e0 0x7fcb48003e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000c240 tx=0x7fcb48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177b775af7c46b0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50007d10 con 0x7fcb480039e0 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb50005ad0 con 0x7fcb480039e0 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb5e7fc640 1 -- 172.21.15.12:0/2153233987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb50007070 con 0x7fcb480039e0 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 -- 172.21.15.12:0/2153233987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb480039e0 msgr2=0x7fcb48003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 --2- 172.21.15.12:0/2153233987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb480039e0 0x7fcb48003e00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000c240 tx=0x7fcb48005830 comp rx=0 tx=0).stop 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb5ffff640 1 -- 172.21.15.12:0/2153233987 reap_dead start 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 -- 172.21.15.12:0/2153233987 shutdown_connections 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 -- 172.21.15.12:0/2153233987 >> 172.21.15.12:0/2153233987 conn(0x7fcb60068090 msgr2=0x7fcb600684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 -- 172.21.15.12:0/2153233987 shutdown_connections 2024-04-26T17:58:50.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.058+0000 7fcb66146640 1 -- 172.21.15.12:0/2153233987 wait complete. 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 Processor -- start 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 -- start start 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 0x7fcb601f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb601e2390 0x7fcb601e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fcb600cdd30 con 0x7fcb6015c220 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fcb60156440 con 0x7fcb480039e0 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.060+0000 7fcb66146640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fcb600ce010 con 0x7fcb601e2390 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47040/0 (socket says 172.21.15.12:47040) 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 -- 172.21.15.12:0/2570049259 learned_addr learned my addr 172.21.15.12:0/2570049259 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5ffff640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb601e2390 0x7fcb601e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 0x7fcb601f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 -- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb601e2390 msgr2=0x7fcb601e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb601e2390 0x7fcb601e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 -- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 msgr2=0x7fcb601f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 0x7fcb601f2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 -- 172.21.15.12:0/2570049259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb601f25a0 con 0x7fcb6015c220 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 0x7fcb601f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:50.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb5effd640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400f5f0 tx=0x7fcb5400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb540052e0 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb54018070 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb54003810 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb601e7100 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.061+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb601e76e0 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.062+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb60076d20 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.063+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb540039b0 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.063+0000 7fcb47fff640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 0x7fcb4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.063+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcb5408bc40 con 0x7fcb6015c220 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.063+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 0x7fcb4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.064+0000 7fcb5f7fe640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 0x7fcb4c06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcb50033000 tx=0x7fcb5002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.067+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb54059d30 con 0x7fcb6015c220 2024-04-26T17:58:50.251 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.251+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb601e2d80 con 0x7fcb4c06c920 2024-04-26T17:58:50.258 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.260+0000 7fcb47fff640 1 -- 172.21.15.12:0/2570049259 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7fcb601e2d80 con 0x7fcb4c06c920 2024-04-26T17:58:50.262 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:50.264 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 msgr2=0x7fcb4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 0x7fcb4c06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcb50033000 tx=0x7fcb5002e000 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 msgr2=0x7fcb6015b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400f5f0 tx=0x7fcb5400fab0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 shutdown_connections 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fcb4c06c920 0x7fcb4c06ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcb601e2390 0x7fcb601e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb6015c220 0x7fcb6015b190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 --2- 172.21.15.12:0/2570049259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb480039e0 0x7fcb601f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 >> 172.21.15.12:0/2570049259 conn(0x7fcb60068090 msgr2=0x7fcb600d05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.266 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 shutdown_connections 2024-04-26T17:58:50.267 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.263+0000 7fcb66146640 1 -- 172.21.15.12:0/2570049259 wait complete. 2024-04-26T17:58:50.273 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-26T17:58:49.883193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003108"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516350+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T17:58:18.516350+0000","last_peered":"2024-04-26T17:58:18.516350+0000","last_clean":"2024-04-26T17:58:18.516350+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T17:58:18.516350+0000","last_undegraded":"2024-04-26T17:58:18.516350+0000","last_fullsized":"2024-04-26T17:58:18.516350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385220+0000","last_change":"2024-04-26T17:58:13.496318+0000","last_active":"2024-04-26T17:58:19.385220+0000","last_peered":"2024-04-26T17:58:19.385220+0000","last_clean":"2024-04-26T17:58:19.385220+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T17:58:19.385220+0000","last_undegraded":"2024-04-26T17:58:19.385220+0000","last_fullsized":"2024-04-26T17:58:19.385220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:40.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384373+0000","last_change":"2024-04-26T17:58:17.709181+0000","last_active":"2024-04-26T17:58:19.384373+0000","last_peered":"2024-04-26T17:58:19.384373+0000","last_clean":"2024-04-26T17:58:19.384373+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T17:58:19.384373+0000","last_undegraded":"2024-04-26T17:58:19.384373+0000","last_fullsized":"2024-04-26T17:58:19.384373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:08.221285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385505+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T17:58:19.385505+0000","last_peered":"2024-04-26T17:58:19.385505+0000","last_clean":"2024-04-26T17:58:19.385505+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T17:58:19.385505+0000","last_undegraded":"2024-04-26T17:58:19.385505+0000","last_fullsized":"2024-04-26T17:58:19.385505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516196+0000","last_change":"2024-04-26T17:58:13.496344+0000","last_active":"2024-04-26T17:58:18.516196+0000","last_peered":"2024-04-26T17:58:18.516196+0000","last_clean":"2024-04-26T17:58:18.516196+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T17:58:18.516196+0000","last_undegraded":"2024-04-26T17:58:18.516196+0000","last_fullsized":"2024-04-26T17:58:18.516196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:24:59.313655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615574+0000","last_change":"2024-04-26T17:58:17.538914+0000","last_active":"2024-04-26T17:58:18.615574+0000","last_peered":"2024-04-26T17:58:18.615574+0000","last_clean":"2024-04-26T17:58:18.615574+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T17:58:18.615574+0000","last_undegraded":"2024-04-26T17:58:18.615574+0000","last_fullsized":"2024-04-26T17:58:18.615574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:18.634983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165655+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T17:58:19.165655+0000","last_peered":"2024-04-26T17:58:19.165655+0000","last_clean":"2024-04-26T17:58:19.165655+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T17:58:19.165655+0000","last_undegraded":"2024-04-26T17:58:19.165655+0000","last_fullsized":"2024-04-26T17:58:19.165655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517989+0000","last_change":"2024-04-26T17:58:13.500796+0000","last_active":"2024-04-26T17:58:18.517989+0000","last_peered":"2024-04-26T17:58:18.517989+0000","last_clean":"2024-04-26T17:58:18.517989+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T17:58:18.517989+0000","last_undegraded":"2024-04-26T17:58:18.517989+0000","last_fullsized":"2024-04-26T17:58:18.517989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:14:01.129614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615675+0000","last_change":"2024-04-26T17:58:17.538844+0000","last_active":"2024-04-26T17:58:18.615675+0000","last_peered":"2024-04-26T17:58:18.615675+0000","last_clean":"2024-04-26T17:58:18.615675+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T17:58:18.615675+0000","last_undegraded":"2024-04-26T17:58:18.615675+0000","last_fullsized":"2024-04-26T17:58:18.615675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:26:46.685130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165402+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T17:58:19.165402+0000","last_peered":"2024-04-26T17:58:19.165402+0000","last_clean":"2024-04-26T17:58:19.165402+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T17:58:19.165402+0000","last_undegraded":"2024-04-26T17:58:19.165402+0000","last_fullsized":"2024-04-26T17:58:19.165402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518761+0000","last_change":"2024-04-26T17:58:13.501280+0000","last_active":"2024-04-26T17:58:18.518761+0000","last_peered":"2024-04-26T17:58:18.518761+0000","last_clean":"2024-04-26T17:58:18.518761+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T17:58:18.518761+0000","last_undegraded":"2024-04-26T17:58:18.518761+0000","last_fullsized":"2024-04-26T17:58:18.518761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:00:45.423437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615678+0000","last_change":"2024-04-26T17:58:17.539919+0000","last_active":"2024-04-26T17:58:18.615678+0000","last_peered":"2024-04-26T17:58:18.615678+0000","last_clean":"2024-04-26T17:58:18.615678+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T17:58:18.615678+0000","last_undegraded":"2024-04-26T17:58:18.615678+0000","last_fullsized":"2024-04-26T17:58:18.615678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:35:47.204681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517143+0000","last_change":"2024-04-26T17:58:13.490862+0000","last_active":"2024-04-26T17:58:18.517143+0000","last_peered":"2024-04-26T17:58:18.517143+0000","last_clean":"2024-04-26T17:58:18.517143+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T17:58:18.517143+0000","last_undegraded":"2024-04-26T17:58:18.517143+0000","last_fullsized":"2024-04-26T17:58:18.517143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:00.826323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165484+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T17:58:19.165484+0000","last_peered":"2024-04-26T17:58:19.165484+0000","last_clean":"2024-04-26T17:58:19.165484+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T17:58:19.165484+0000","last_undegraded":"2024-04-26T17:58:19.165484+0000","last_fullsized":"2024-04-26T17:58:19.165484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616183+0000","last_change":"2024-04-26T17:58:17.540139+0000","last_active":"2024-04-26T17:58:18.616183+0000","last_peered":"2024-04-26T17:58:18.616183+0000","last_clean":"2024-04-26T17:58:18.616183+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T17:58:18.616183+0000","last_undegraded":"2024-04-26T17:58:18.616183+0000","last_fullsized":"2024-04-26T17:58:18.616183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:17.153327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383998+0000","last_change":"2024-04-26T17:58:13.495769+0000","last_active":"2024-04-26T17:58:19.383998+0000","last_peered":"2024-04-26T17:58:19.383998+0000","last_clean":"2024-04-26T17:58:19.383998+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T17:58:19.383998+0000","last_undegraded":"2024-04-26T17:58:19.383998+0000","last_fullsized":"2024-04-26T17:58:19.383998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:43.263906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384447+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T17:58:19.384447+0000","last_peered":"2024-04-26T17:58:19.384447+0000","last_clean":"2024-04-26T17:58:19.384447+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T17:58:19.384447+0000","last_undegraded":"2024-04-26T17:58:19.384447+0000","last_fullsized":"2024-04-26T17:58:19.384447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616009+0000","last_change":"2024-04-26T17:58:17.537026+0000","last_active":"2024-04-26T17:58:18.616009+0000","last_peered":"2024-04-26T17:58:18.616009+0000","last_clean":"2024-04-26T17:58:18.616009+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T17:58:18.616009+0000","last_undegraded":"2024-04-26T17:58:18.616009+0000","last_fullsized":"2024-04-26T17:58:18.616009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:05.302464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385364+0000","last_change":"2024-04-26T17:58:13.499021+0000","last_active":"2024-04-26T17:58:19.385364+0000","last_peered":"2024-04-26T17:58:19.385364+0000","last_clean":"2024-04-26T17:58:19.385364+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T17:58:19.385364+0000","last_undegraded":"2024-04-26T17:58:19.385364+0000","last_fullsized":"2024-04-26T17:58:19.385364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:56:10.989781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383654+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T17:58:19.383654+0000","last_peered":"2024-04-26T17:58:19.383654+0000","last_clean":"2024-04-26T17:58:19.383654+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T17:58:19.383654+0000","last_undegraded":"2024-04-26T17:58:19.383654+0000","last_fullsized":"2024-04-26T17:58:19.383654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384355+0000","last_change":"2024-04-26T17:58:17.705467+0000","last_active":"2024-04-26T17:58:19.384355+0000","last_peered":"2024-04-26T17:58:19.384355+0000","last_clean":"2024-04-26T17:58:19.384355+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T17:58:19.384355+0000","last_undegraded":"2024-04-26T17:58:19.384355+0000","last_fullsized":"2024-04-26T17:58:19.384355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:30:08.083096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615720+0000","last_change":"2024-04-26T17:58:13.492343+0000","last_active":"2024-04-26T17:58:18.615720+0000","last_peered":"2024-04-26T17:58:18.615720+0000","last_clean":"2024-04-26T17:58:18.615720+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T17:58:18.615720+0000","last_undegraded":"2024-04-26T17:58:18.615720+0000","last_fullsized":"2024-04-26T17:58:18.615720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:03:50.364885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165062+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T17:58:19.165062+0000","last_peered":"2024-04-26T17:58:19.165062+0000","last_clean":"2024-04-26T17:58:19.165062+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T17:58:19.165062+0000","last_undegraded":"2024-04-26T17:58:19.165062+0000","last_fullsized":"2024-04-26T17:58:19.165062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616181+0000","last_change":"2024-04-26T17:58:17.531122+0000","last_active":"2024-04-26T17:58:18.616181+0000","last_peered":"2024-04-26T17:58:18.616181+0000","last_clean":"2024-04-26T17:58:18.616181+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T17:58:18.616181+0000","last_undegraded":"2024-04-26T17:58:18.616181+0000","last_fullsized":"2024-04-26T17:58:18.616181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:36:39.573742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516176+0000","last_change":"2024-04-26T17:58:13.499836+0000","last_active":"2024-04-26T17:58:18.516176+0000","last_peered":"2024-04-26T17:58:18.516176+0000","last_clean":"2024-04-26T17:58:18.516176+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T17:58:18.516176+0000","last_undegraded":"2024-04-26T17:58:18.516176+0000","last_fullsized":"2024-04-26T17:58:18.516176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:41:01.693151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518313+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T17:58:18.518313+0000","last_peered":"2024-04-26T17:58:18.518313+0000","last_clean":"2024-04-26T17:58:18.518313+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T17:58:18.518313+0000","last_undegraded":"2024-04-26T17:58:18.518313+0000","last_fullsized":"2024-04-26T17:58:18.518313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615624+0000","last_change":"2024-04-26T17:58:17.708696+0000","last_active":"2024-04-26T17:58:18.615624+0000","last_peered":"2024-04-26T17:58:18.615624+0000","last_clean":"2024-04-26T17:58:18.615624+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T17:58:18.615624+0000","last_undegraded":"2024-04-26T17:58:18.615624+0000","last_fullsized":"2024-04-26T17:58:18.615624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:02.863127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385445+0000","last_change":"2024-04-26T17:58:13.497888+0000","last_active":"2024-04-26T17:58:19.385445+0000","last_peered":"2024-04-26T17:58:19.385445+0000","last_clean":"2024-04-26T17:58:19.385445+0000","last_became_active":"2024-04-26T17:58:13.497476+0000","last_became_peered":"2024-04-26T17:58:13.497476+0000","last_unstale":"2024-04-26T17:58:19.385445+0000","last_undegraded":"2024-04-26T17:58:19.385445+0000","last_fullsized":"2024-04-26T17:58:19.385445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:10.994458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384860+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T17:58:19.384860+0000","last_peered":"2024-04-26T17:58:19.384860+0000","last_clean":"2024-04-26T17:58:19.384860+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T17:58:19.384860+0000","last_undegraded":"2024-04-26T17:58:19.384860+0000","last_fullsized":"2024-04-26T17:58:19.384860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384991+0000","last_change":"2024-04-26T17:58:17.708273+0000","last_active":"2024-04-26T17:58:19.384991+0000","last_peered":"2024-04-26T17:58:19.384991+0000","last_clean":"2024-04-26T17:58:19.384991+0000","last_became_active":"2024-04-26T17:58:17.707919+0000","last_became_peered":"2024-04-26T17:58:17.707919+0000","last_unstale":"2024-04-26T17:58:19.384991+0000","last_undegraded":"2024-04-26T17:58:19.384991+0000","last_fullsized":"2024-04-26T17:58:19.384991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:59:55.104238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384018+0000","last_change":"2024-04-26T17:58:13.498399+0000","last_active":"2024-04-26T17:58:19.384018+0000","last_peered":"2024-04-26T17:58:19.384018+0000","last_clean":"2024-04-26T17:58:19.384018+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T17:58:19.384018+0000","last_undegraded":"2024-04-26T17:58:19.384018+0000","last_fullsized":"2024-04-26T17:58:19.384018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:23:51.532911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165809+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T17:58:19.165809+0000","last_peered":"2024-04-26T17:58:19.165809+0000","last_clean":"2024-04-26T17:58:19.165809+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T17:58:19.165809+0000","last_undegraded":"2024-04-26T17:58:19.165809+0000","last_fullsized":"2024-04-26T17:58:19.165809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515645+0000","last_change":"2024-04-26T17:58:17.705479+0000","last_active":"2024-04-26T17:58:18.515645+0000","last_peered":"2024-04-26T17:58:18.515645+0000","last_clean":"2024-04-26T17:58:18.515645+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T17:58:18.515645+0000","last_undegraded":"2024-04-26T17:58:18.515645+0000","last_fullsized":"2024-04-26T17:58:18.515645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:38:10.613011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518792+0000","last_change":"2024-04-26T17:58:13.499060+0000","last_active":"2024-04-26T17:58:18.518792+0000","last_peered":"2024-04-26T17:58:18.518792+0000","last_clean":"2024-04-26T17:58:18.518792+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T17:58:18.518792+0000","last_undegraded":"2024-04-26T17:58:18.518792+0000","last_fullsized":"2024-04-26T17:58:18.518792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:43:30.531599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384120+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T17:58:19.384120+0000","last_peered":"2024-04-26T17:58:19.384120+0000","last_clean":"2024-04-26T17:58:19.384120+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T17:58:19.384120+0000","last_undegraded":"2024-04-26T17:58:19.384120+0000","last_fullsized":"2024-04-26T17:58:19.384120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383979+0000","last_change":"2024-04-26T17:58:17.539223+0000","last_active":"2024-04-26T17:58:19.383979+0000","last_peered":"2024-04-26T17:58:19.383979+0000","last_clean":"2024-04-26T17:58:19.383979+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T17:58:19.383979+0000","last_undegraded":"2024-04-26T17:58:19.383979+0000","last_fullsized":"2024-04-26T17:58:19.383979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:04:51.321058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615907+0000","last_change":"2024-04-26T17:58:13.491970+0000","last_active":"2024-04-26T17:58:18.615907+0000","last_peered":"2024-04-26T17:58:18.615907+0000","last_clean":"2024-04-26T17:58:18.615907+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T17:58:18.615907+0000","last_undegraded":"2024-04-26T17:58:18.615907+0000","last_fullsized":"2024-04-26T17:58:18.615907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:47:41.916707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518892+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T17:58:18.518892+0000","last_peered":"2024-04-26T17:58:18.518892+0000","last_clean":"2024-04-26T17:58:18.518892+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T17:58:18.518892+0000","last_undegraded":"2024-04-26T17:58:18.518892+0000","last_fullsized":"2024-04-26T17:58:18.518892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384267+0000","last_change":"2024-04-26T17:58:17.534107+0000","last_active":"2024-04-26T17:58:19.384267+0000","last_peered":"2024-04-26T17:58:19.384267+0000","last_clean":"2024-04-26T17:58:19.384267+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T17:58:19.384267+0000","last_undegraded":"2024-04-26T17:58:19.384267+0000","last_fullsized":"2024-04-26T17:58:19.384267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:31:26.871554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383650+0000","last_change":"2024-04-26T17:58:13.496508+0000","last_active":"2024-04-26T17:58:19.383650+0000","last_peered":"2024-04-26T17:58:19.383650+0000","last_clean":"2024-04-26T17:58:19.383650+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T17:58:19.383650+0000","last_undegraded":"2024-04-26T17:58:19.383650+0000","last_fullsized":"2024-04-26T17:58:19.383650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:49:28.992349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383546+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T17:58:19.383546+0000","last_peered":"2024-04-26T17:58:19.383546+0000","last_clean":"2024-04-26T17:58:19.383546+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T17:58:19.383546+0000","last_undegraded":"2024-04-26T17:58:19.383546+0000","last_fullsized":"2024-04-26T17:58:19.383546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384508+0000","last_change":"2024-04-26T17:58:17.542049+0000","last_active":"2024-04-26T17:58:19.384508+0000","last_peered":"2024-04-26T17:58:19.384508+0000","last_clean":"2024-04-26T17:58:19.384508+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T17:58:19.384508+0000","last_undegraded":"2024-04-26T17:58:19.384508+0000","last_fullsized":"2024-04-26T17:58:19.384508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:58:08.451145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515443+0000","last_change":"2024-04-26T17:58:13.494252+0000","last_active":"2024-04-26T17:58:18.515443+0000","last_peered":"2024-04-26T17:58:18.515443+0000","last_clean":"2024-04-26T17:58:18.515443+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T17:58:18.515443+0000","last_undegraded":"2024-04-26T17:58:18.515443+0000","last_fullsized":"2024-04-26T17:58:18.515443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:34.864820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165090+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T17:58:19.165090+0000","last_peered":"2024-04-26T17:58:19.165090+0000","last_clean":"2024-04-26T17:58:19.165090+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T17:58:19.165090+0000","last_undegraded":"2024-04-26T17:58:19.165090+0000","last_fullsized":"2024-04-26T17:58:19.165090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516155+0000","last_change":"2024-04-26T17:58:17.706535+0000","last_active":"2024-04-26T17:58:18.516155+0000","last_peered":"2024-04-26T17:58:18.516155+0000","last_clean":"2024-04-26T17:58:18.516155+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T17:58:18.516155+0000","last_undegraded":"2024-04-26T17:58:18.516155+0000","last_fullsized":"2024-04-26T17:58:18.516155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:41.647518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383649+0000","last_change":"2024-04-26T17:58:13.503132+0000","last_active":"2024-04-26T17:58:19.383649+0000","last_peered":"2024-04-26T17:58:19.383649+0000","last_clean":"2024-04-26T17:58:19.383649+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T17:58:19.383649+0000","last_undegraded":"2024-04-26T17:58:19.383649+0000","last_fullsized":"2024-04-26T17:58:19.383649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:38:21.207145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517940+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T17:58:18.517940+0000","last_peered":"2024-04-26T17:58:18.517940+0000","last_clean":"2024-04-26T17:58:18.517940+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T17:58:18.517940+0000","last_undegraded":"2024-04-26T17:58:18.517940+0000","last_fullsized":"2024-04-26T17:58:18.517940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.164891+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T17:58:19.164891+0000","last_peered":"2024-04-26T17:58:19.164891+0000","last_clean":"2024-04-26T17:58:19.164891+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T17:58:19.164891+0000","last_undegraded":"2024-04-26T17:58:19.164891+0000","last_fullsized":"2024-04-26T17:58:19.164891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517395+0000","last_change":"2024-04-26T17:58:17.708375+0000","last_active":"2024-04-26T17:58:18.517395+0000","last_peered":"2024-04-26T17:58:18.517395+0000","last_clean":"2024-04-26T17:58:18.517395+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T17:58:18.517395+0000","last_undegraded":"2024-04-26T17:58:18.517395+0000","last_fullsized":"2024-04-26T17:58:18.517395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:23:21.877462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165410+0000","last_change":"2024-04-26T17:58:13.503396+0000","last_active":"2024-04-26T17:58:19.165410+0000","last_peered":"2024-04-26T17:58:19.165410+0000","last_clean":"2024-04-26T17:58:19.165410+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T17:58:19.165410+0000","last_undegraded":"2024-04-26T17:58:19.165410+0000","last_fullsized":"2024-04-26T17:58:19.165410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:53.053902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384279+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T17:58:19.384279+0000","last_peered":"2024-04-26T17:58:19.384279+0000","last_clean":"2024-04-26T17:58:19.384279+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T17:58:19.384279+0000","last_undegraded":"2024-04-26T17:58:19.384279+0000","last_fullsized":"2024-04-26T17:58:19.384279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517525+0000","last_change":"2024-04-26T17:58:17.705496+0000","last_active":"2024-04-26T17:58:18.517525+0000","last_peered":"2024-04-26T17:58:18.517525+0000","last_clean":"2024-04-26T17:58:18.517525+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T17:58:18.517525+0000","last_undegraded":"2024-04-26T17:58:18.517525+0000","last_fullsized":"2024-04-26T17:58:18.517525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:04.199582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518079+0000","last_change":"2024-04-26T17:58:13.498631+0000","last_active":"2024-04-26T17:58:18.518079+0000","last_peered":"2024-04-26T17:58:18.518079+0000","last_clean":"2024-04-26T17:58:18.518079+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T17:58:18.518079+0000","last_undegraded":"2024-04-26T17:58:18.518079+0000","last_fullsized":"2024-04-26T17:58:18.518079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:37.364124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384572+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T17:58:19.384572+0000","last_peered":"2024-04-26T17:58:19.384572+0000","last_clean":"2024-04-26T17:58:19.384572+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T17:58:19.384572+0000","last_undegraded":"2024-04-26T17:58:19.384572+0000","last_fullsized":"2024-04-26T17:58:19.384572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515894+0000","last_change":"2024-04-26T17:58:17.542501+0000","last_active":"2024-04-26T17:58:18.515894+0000","last_peered":"2024-04-26T17:58:18.515894+0000","last_clean":"2024-04-26T17:58:18.515894+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T17:58:18.515894+0000","last_undegraded":"2024-04-26T17:58:18.515894+0000","last_fullsized":"2024-04-26T17:58:18.515894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:35.381211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165792+0000","last_change":"2024-04-26T17:58:13.505129+0000","last_active":"2024-04-26T17:58:19.165792+0000","last_peered":"2024-04-26T17:58:19.165792+0000","last_clean":"2024-04-26T17:58:19.165792+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T17:58:19.165792+0000","last_undegraded":"2024-04-26T17:58:19.165792+0000","last_fullsized":"2024-04-26T17:58:19.165792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:04.265525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383509+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T17:58:19.383509+0000","last_peered":"2024-04-26T17:58:19.383509+0000","last_clean":"2024-04-26T17:58:19.383509+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T17:58:19.383509+0000","last_undegraded":"2024-04-26T17:58:19.383509+0000","last_fullsized":"2024-04-26T17:58:19.383509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517576+0000","last_change":"2024-04-26T17:58:17.708260+0000","last_active":"2024-04-26T17:58:18.517576+0000","last_peered":"2024-04-26T17:58:18.517576+0000","last_clean":"2024-04-26T17:58:18.517576+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T17:58:18.517576+0000","last_undegraded":"2024-04-26T17:58:18.517576+0000","last_fullsized":"2024-04-26T17:58:18.517576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:15:51.196684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165708+0000","last_change":"2024-04-26T17:58:13.503550+0000","last_active":"2024-04-26T17:58:19.165708+0000","last_peered":"2024-04-26T17:58:19.165708+0000","last_clean":"2024-04-26T17:58:19.165708+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T17:58:19.165708+0000","last_undegraded":"2024-04-26T17:58:19.165708+0000","last_fullsized":"2024-04-26T17:58:19.165708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:30:21.789931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616305+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T17:58:18.616305+0000","last_peered":"2024-04-26T17:58:18.616305+0000","last_clean":"2024-04-26T17:58:18.616305+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T17:58:18.616305+0000","last_undegraded":"2024-04-26T17:58:18.616305+0000","last_fullsized":"2024-04-26T17:58:18.616305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615448+0000","last_change":"2024-04-26T17:58:17.537463+0000","last_active":"2024-04-26T17:58:18.615448+0000","last_peered":"2024-04-26T17:58:18.615448+0000","last_clean":"2024-04-26T17:58:18.615448+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T17:58:18.615448+0000","last_undegraded":"2024-04-26T17:58:18.615448+0000","last_fullsized":"2024-04-26T17:58:18.615448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:21:19.157409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165384+0000","last_change":"2024-04-26T17:58:13.502939+0000","last_active":"2024-04-26T17:58:19.165384+0000","last_peered":"2024-04-26T17:58:19.165384+0000","last_clean":"2024-04-26T17:58:19.165384+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T17:58:19.165384+0000","last_undegraded":"2024-04-26T17:58:19.165384+0000","last_fullsized":"2024-04-26T17:58:19.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:44:23.282373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383169+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T17:58:19.383169+0000","last_peered":"2024-04-26T17:58:19.383169+0000","last_clean":"2024-04-26T17:58:19.383169+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T17:58:19.383169+0000","last_undegraded":"2024-04-26T17:58:19.383169+0000","last_fullsized":"2024-04-26T17:58:19.383169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515965+0000","last_change":"2024-04-26T17:58:17.541211+0000","last_active":"2024-04-26T17:58:18.515965+0000","last_peered":"2024-04-26T17:58:18.515965+0000","last_clean":"2024-04-26T17:58:18.515965+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T17:58:18.515965+0000","last_undegraded":"2024-04-26T17:58:18.515965+0000","last_fullsized":"2024-04-26T17:58:18.515965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:03:16.998033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517072+0000","last_change":"2024-04-26T17:58:13.492196+0000","last_active":"2024-04-26T17:58:18.517072+0000","last_peered":"2024-04-26T17:58:18.517072+0000","last_clean":"2024-04-26T17:58:18.517072+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T17:58:18.517072+0000","last_undegraded":"2024-04-26T17:58:18.517072+0000","last_fullsized":"2024-04-26T17:58:18.517072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:59:45.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517982+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T17:58:18.517982+0000","last_peered":"2024-04-26T17:58:18.517982+0000","last_clean":"2024-04-26T17:58:18.517982+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T17:58:18.517982+0000","last_undegraded":"2024-04-26T17:58:18.517982+0000","last_fullsized":"2024-04-26T17:58:18.517982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385367+0000","last_change":"2024-04-26T17:58:17.708393+0000","last_active":"2024-04-26T17:58:19.385367+0000","last_peered":"2024-04-26T17:58:19.385367+0000","last_clean":"2024-04-26T17:58:19.385367+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T17:58:19.385367+0000","last_undegraded":"2024-04-26T17:58:19.385367+0000","last_fullsized":"2024-04-26T17:58:19.385367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:05.294250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165336+0000","last_change":"2024-04-26T17:58:13.502742+0000","last_active":"2024-04-26T17:58:19.165336+0000","last_peered":"2024-04-26T17:58:19.165336+0000","last_clean":"2024-04-26T17:58:19.165336+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T17:58:19.165336+0000","last_undegraded":"2024-04-26T17:58:19.165336+0000","last_fullsized":"2024-04-26T17:58:19.165336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.527142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518800+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T17:58:18.518800+0000","last_peered":"2024-04-26T17:58:18.518800+0000","last_clean":"2024-04-26T17:58:18.518800+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T17:58:18.518800+0000","last_undegraded":"2024-04-26T17:58:18.518800+0000","last_fullsized":"2024-04-26T17:58:18.518800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385405+0000","last_change":"2024-04-26T17:58:17.705544+0000","last_active":"2024-04-26T17:58:19.385405+0000","last_peered":"2024-04-26T17:58:19.385405+0000","last_clean":"2024-04-26T17:58:19.385405+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T17:58:19.385405+0000","last_undegraded":"2024-04-26T17:58:19.385405+0000","last_fullsized":"2024-04-26T17:58:19.385405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:15.606501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515761+0000","last_change":"2024-04-26T17:58:13.497048+0000","last_active":"2024-04-26T17:58:18.515761+0000","last_peered":"2024-04-26T17:58:18.515761+0000","last_clean":"2024-04-26T17:58:18.515761+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T17:58:18.515761+0000","last_undegraded":"2024-04-26T17:58:18.515761+0000","last_fullsized":"2024-04-26T17:58:18.515761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:14:57.877009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516061+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T17:58:18.516061+0000","last_peered":"2024-04-26T17:58:18.516061+0000","last_clean":"2024-04-26T17:58:18.516061+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T17:58:18.516061+0000","last_undegraded":"2024-04-26T17:58:18.516061+0000","last_fullsized":"2024-04-26T17:58:18.516061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518698+0000","last_change":"2024-04-26T17:58:17.705538+0000","last_active":"2024-04-26T17:58:18.518698+0000","last_peered":"2024-04-26T17:58:18.518698+0000","last_clean":"2024-04-26T17:58:18.518698+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T17:58:18.518698+0000","last_undegraded":"2024-04-26T17:58:18.518698+0000","last_fullsized":"2024-04-26T17:58:18.518698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:46.471290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165361+0000","last_change":"2024-04-26T17:58:13.505185+0000","last_active":"2024-04-26T17:58:19.165361+0000","last_peered":"2024-04-26T17:58:19.165361+0000","last_clean":"2024-04-26T17:58:19.165361+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T17:58:19.165361+0000","last_undegraded":"2024-04-26T17:58:19.165361+0000","last_fullsized":"2024-04-26T17:58:19.165361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:10:06.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:28.307679+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T17:58:28.307679+0000","last_peered":"2024-04-26T17:58:28.307679+0000","last_clean":"2024-04-26T17:58:28.307679+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T17:58:28.307679+0000","last_undegraded":"2024-04-26T17:58:28.307679+0000","last_fullsized":"2024-04-26T17:58:28.307679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384231+0000","last_change":"2024-04-26T17:58:17.542700+0000","last_active":"2024-04-26T17:58:19.384231+0000","last_peered":"2024-04-26T17:58:19.384231+0000","last_clean":"2024-04-26T17:58:19.384231+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T17:58:19.384231+0000","last_undegraded":"2024-04-26T17:58:19.384231+0000","last_fullsized":"2024-04-26T17:58:19.384231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:28:36.246668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616177+0000","last_change":"2024-04-26T17:58:13.498135+0000","last_active":"2024-04-26T17:58:18.616177+0000","last_peered":"2024-04-26T17:58:18.616177+0000","last_clean":"2024-04-26T17:58:18.616177+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T17:58:18.616177+0000","last_undegraded":"2024-04-26T17:58:18.616177+0000","last_fullsized":"2024-04-26T17:58:18.616177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:11.147529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384461+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T17:58:19.384461+0000","last_peered":"2024-04-26T17:58:19.384461+0000","last_clean":"2024-04-26T17:58:19.384461+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T17:58:19.384461+0000","last_undegraded":"2024-04-26T17:58:19.384461+0000","last_fullsized":"2024-04-26T17:58:19.384461+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615796+0000","last_change":"2024-04-26T17:58:17.530999+0000","last_active":"2024-04-26T17:58:18.615796+0000","last_peered":"2024-04-26T17:58:18.615796+0000","last_clean":"2024-04-26T17:58:18.615796+0000","last_became_active":"2024-04-26T17:58:17.530589+0000","last_became_peered":"2024-04-26T17:58:17.530589+0000","last_unstale":"2024-04-26T17:58:18.615796+0000","last_undegraded":"2024-04-26T17:58:18.615796+0000","last_fullsized":"2024-04-26T17:58:18.615796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:37:49.603920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516303+0000","last_change":"2024-04-26T17:58:13.496011+0000","last_active":"2024-04-26T17:58:18.516303+0000","last_peered":"2024-04-26T17:58:18.516303+0000","last_clean":"2024-04-26T17:58:18.516303+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T17:58:18.516303+0000","last_undegraded":"2024-04-26T17:58:18.516303+0000","last_fullsized":"2024-04-26T17:58:18.516303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:28:50.119604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517857+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T17:58:18.517857+0000","last_peered":"2024-04-26T17:58:18.517857+0000","last_clean":"2024-04-26T17:58:18.517857+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T17:58:18.517857+0000","last_undegraded":"2024-04-26T17:58:18.517857+0000","last_fullsized":"2024-04-26T17:58:18.517857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385166+0000","last_change":"2024-04-26T17:58:17.534315+0000","last_active":"2024-04-26T17:58:19.385166+0000","last_peered":"2024-04-26T17:58:19.385166+0000","last_clean":"2024-04-26T17:58:19.385166+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T17:58:19.385166+0000","last_undegraded":"2024-04-26T17:58:19.385166+0000","last_fullsized":"2024-04-26T17:58:19.385166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:19.652982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517791+0000","last_change":"2024-04-26T17:58:13.496969+0000","last_active":"2024-04-26T17:58:18.517791+0000","last_peered":"2024-04-26T17:58:18.517791+0000","last_clean":"2024-04-26T17:58:18.517791+0000","last_became_active":"2024-04-26T17:58:13.496393+0000","last_became_peered":"2024-04-26T17:58:13.496393+0000","last_unstale":"2024-04-26T17:58:18.517791+0000","last_undegraded":"2024-04-26T17:58:18.517791+0000","last_fullsized":"2024-04-26T17:58:18.517791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:41.241727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518118+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T17:58:18.518118+0000","last_peered":"2024-04-26T17:58:18.518118+0000","last_clean":"2024-04-26T17:58:18.518118+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T17:58:18.518118+0000","last_undegraded":"2024-04-26T17:58:18.518118+0000","last_fullsized":"2024-04-26T17:58:18.518118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384532+0000","last_change":"2024-04-26T17:58:17.709737+0000","last_active":"2024-04-26T17:58:19.384532+0000","last_peered":"2024-04-26T17:58:19.384532+0000","last_clean":"2024-04-26T17:58:19.384532+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T17:58:19.384532+0000","last_undegraded":"2024-04-26T17:58:19.384532+0000","last_fullsized":"2024-04-26T17:58:19.384532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:16:01.221034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515950+0000","last_change":"2024-04-26T17:58:17.708550+0000","last_active":"2024-04-26T17:58:18.515950+0000","last_peered":"2024-04-26T17:58:18.515950+0000","last_clean":"2024-04-26T17:58:18.515950+0000","last_became_active":"2024-04-26T17:58:17.708155+0000","last_became_peered":"2024-04-26T17:58:17.708155+0000","last_unstale":"2024-04-26T17:58:18.515950+0000","last_undegraded":"2024-04-26T17:58:18.515950+0000","last_fullsized":"2024-04-26T17:58:18.515950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:12:30.400705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383467+0000","last_change":"2024-04-26T17:58:13.505696+0000","last_active":"2024-04-26T17:58:19.383467+0000","last_peered":"2024-04-26T17:58:19.383467+0000","last_clean":"2024-04-26T17:58:19.383467+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T17:58:19.383467+0000","last_undegraded":"2024-04-26T17:58:19.383467+0000","last_fullsized":"2024-04-26T17:58:19.383467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:28:00.909500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518505+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T17:58:18.518505+0000","last_peered":"2024-04-26T17:58:18.518505+0000","last_clean":"2024-04-26T17:58:18.518505+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T17:58:18.518505+0000","last_undegraded":"2024-04-26T17:58:18.518505+0000","last_fullsized":"2024-04-26T17:58:18.518505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517947+0000","last_change":"2024-04-26T17:58:17.536121+0000","last_active":"2024-04-26T17:58:18.517947+0000","last_peered":"2024-04-26T17:58:18.517947+0000","last_clean":"2024-04-26T17:58:18.517947+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T17:58:18.517947+0000","last_undegraded":"2024-04-26T17:58:18.517947+0000","last_fullsized":"2024-04-26T17:58:18.517947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:19.320988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385254+0000","last_change":"2024-04-26T17:58:13.498407+0000","last_active":"2024-04-26T17:58:19.385254+0000","last_peered":"2024-04-26T17:58:19.385254+0000","last_clean":"2024-04-26T17:58:19.385254+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T17:58:19.385254+0000","last_undegraded":"2024-04-26T17:58:19.385254+0000","last_fullsized":"2024-04-26T17:58:19.385254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:28:25.176252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384840+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T17:58:19.384840+0000","last_peered":"2024-04-26T17:58:19.384840+0000","last_clean":"2024-04-26T17:58:19.384840+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T17:58:19.384840+0000","last_undegraded":"2024-04-26T17:58:19.384840+0000","last_fullsized":"2024-04-26T17:58:19.384840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517367+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T17:58:18.517367+0000","last_peered":"2024-04-26T17:58:18.517367+0000","last_clean":"2024-04-26T17:58:18.517367+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T17:58:18.517367+0000","last_undegraded":"2024-04-26T17:58:18.517367+0000","last_fullsized":"2024-04-26T17:58:18.517367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516009+0000","last_change":"2024-04-26T17:58:13.493639+0000","last_active":"2024-04-26T17:58:18.516009+0000","last_peered":"2024-04-26T17:58:18.516009+0000","last_clean":"2024-04-26T17:58:18.516009+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T17:58:18.516009+0000","last_undegraded":"2024-04-26T17:58:18.516009+0000","last_fullsized":"2024-04-26T17:58:18.516009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:34:38.567992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384044+0000","last_change":"2024-04-26T17:58:17.533865+0000","last_active":"2024-04-26T17:58:19.384044+0000","last_peered":"2024-04-26T17:58:19.384044+0000","last_clean":"2024-04-26T17:58:19.384044+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T17:58:19.384044+0000","last_undegraded":"2024-04-26T17:58:19.384044+0000","last_fullsized":"2024-04-26T17:58:19.384044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:46:45.272997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384089+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T17:58:19.384089+0000","last_peered":"2024-04-26T17:58:19.384089+0000","last_clean":"2024-04-26T17:58:19.384089+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T17:58:19.384089+0000","last_undegraded":"2024-04-26T17:58:19.384089+0000","last_fullsized":"2024-04-26T17:58:19.384089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.615616+0000","last_change":"2024-04-26T17:58:13.499481+0000","last_active":"2024-04-26T17:58:18.615616+0000","last_peered":"2024-04-26T17:58:18.615616+0000","last_clean":"2024-04-26T17:58:18.615616+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T17:58:18.615616+0000","last_undegraded":"2024-04-26T17:58:18.615616+0000","last_fullsized":"2024-04-26T17:58:18.615616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:06:46.456788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385282+0000","last_change":"2024-04-26T17:58:17.534942+0000","last_active":"2024-04-26T17:58:19.385282+0000","last_peered":"2024-04-26T17:58:19.385282+0000","last_clean":"2024-04-26T17:58:19.385282+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T17:58:19.385282+0000","last_undegraded":"2024-04-26T17:58:19.385282+0000","last_fullsized":"2024-04-26T17:58:19.385282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:24:22.523732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.516973+0000","last_change":"2024-04-26T17:58:13.493694+0000","last_active":"2024-04-26T17:58:18.516973+0000","last_peered":"2024-04-26T17:58:18.516973+0000","last_clean":"2024-04-26T17:58:18.516973+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T17:58:18.516973+0000","last_undegraded":"2024-04-26T17:58:18.516973+0000","last_fullsized":"2024-04-26T17:58:18.516973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:13:28.863502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383448+0000","last_change":"2024-04-26T17:58:13.487729+0000","last_active":"2024-04-26T17:58:19.383448+0000","last_peered":"2024-04-26T17:58:19.383448+0000","last_clean":"2024-04-26T17:58:19.383448+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T17:58:19.383448+0000","last_undegraded":"2024-04-26T17:58:19.383448+0000","last_fullsized":"2024-04-26T17:58:19.383448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:54:25.544147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518705+0000","last_change":"2024-04-26T17:58:13.504267+0000","last_active":"2024-04-26T17:58:18.518705+0000","last_peered":"2024-04-26T17:58:18.518705+0000","last_clean":"2024-04-26T17:58:18.518705+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T17:58:18.518705+0000","last_undegraded":"2024-04-26T17:58:18.518705+0000","last_fullsized":"2024-04-26T17:58:18.518705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:22.289664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515942+0000","last_change":"2024-04-26T17:58:13.495809+0000","last_active":"2024-04-26T17:58:18.515942+0000","last_peered":"2024-04-26T17:58:18.515942+0000","last_clean":"2024-04-26T17:58:18.515942+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T17:58:18.515942+0000","last_undegraded":"2024-04-26T17:58:18.515942+0000","last_fullsized":"2024-04-26T17:58:18.515942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:52.729721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385171+0000","last_change":"2024-04-26T17:58:13.492869+0000","last_active":"2024-04-26T17:58:19.385171+0000","last_peered":"2024-04-26T17:58:19.385171+0000","last_clean":"2024-04-26T17:58:19.385171+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T17:58:19.385171+0000","last_undegraded":"2024-04-26T17:58:19.385171+0000","last_fullsized":"2024-04-26T17:58:19.385171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:48:23.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383919+0000","last_change":"2024-04-26T17:58:13.505141+0000","last_active":"2024-04-26T17:58:19.383919+0000","last_peered":"2024-04-26T17:58:19.383919+0000","last_clean":"2024-04-26T17:58:19.383919+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T17:58:19.383919+0000","last_undegraded":"2024-04-26T17:58:19.383919+0000","last_fullsized":"2024-04-26T17:58:19.383919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:40:05.218532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518618+0000","last_change":"2024-04-26T17:58:13.495261+0000","last_active":"2024-04-26T17:58:18.518618+0000","last_peered":"2024-04-26T17:58:18.518618+0000","last_clean":"2024-04-26T17:58:18.518618+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T17:58:18.518618+0000","last_undegraded":"2024-04-26T17:58:18.518618+0000","last_fullsized":"2024-04-26T17:58:18.518618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:01:22.818902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385343+0000","last_change":"2024-04-26T17:58:13.498733+0000","last_active":"2024-04-26T17:58:19.385343+0000","last_peered":"2024-04-26T17:58:19.385343+0000","last_clean":"2024-04-26T17:58:19.385343+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T17:58:19.385343+0000","last_undegraded":"2024-04-26T17:58:19.385343+0000","last_fullsized":"2024-04-26T17:58:19.385343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:59.318936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518408+0000","last_change":"2024-04-26T17:58:13.499322+0000","last_active":"2024-04-26T17:58:18.518408+0000","last_peered":"2024-04-26T17:58:18.518408+0000","last_clean":"2024-04-26T17:58:18.518408+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T17:58:18.518408+0000","last_undegraded":"2024-04-26T17:58:18.518408+0000","last_fullsized":"2024-04-26T17:58:18.518408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:08:31.285625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384688+0000","last_change":"2024-04-26T17:58:13.499589+0000","last_active":"2024-04-26T17:58:19.384688+0000","last_peered":"2024-04-26T17:58:19.384688+0000","last_clean":"2024-04-26T17:58:19.384688+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T17:58:19.384688+0000","last_undegraded":"2024-04-26T17:58:19.384688+0000","last_fullsized":"2024-04-26T17:58:19.384688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:12.723059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518619+0000","last_change":"2024-04-26T17:58:13.497927+0000","last_active":"2024-04-26T17:58:18.518619+0000","last_peered":"2024-04-26T17:58:18.518619+0000","last_clean":"2024-04-26T17:58:18.518619+0000","last_became_active":"2024-04-26T17:58:13.497449+0000","last_became_peered":"2024-04-26T17:58:13.497449+0000","last_unstale":"2024-04-26T17:58:18.518619+0000","last_undegraded":"2024-04-26T17:58:18.518619+0000","last_fullsized":"2024-04-26T17:58:18.518619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:38:13.773889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515786+0000","last_change":"2024-04-26T17:58:13.496358+0000","last_active":"2024-04-26T17:58:18.515786+0000","last_peered":"2024-04-26T17:58:18.515786+0000","last_clean":"2024-04-26T17:58:18.515786+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T17:58:18.515786+0000","last_undegraded":"2024-04-26T17:58:18.515786+0000","last_fullsized":"2024-04-26T17:58:18.515786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:26:13.120408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517313+0000","last_change":"2024-04-26T17:58:13.492817+0000","last_active":"2024-04-26T17:58:18.517313+0000","last_peered":"2024-04-26T17:58:18.517313+0000","last_clean":"2024-04-26T17:58:18.517313+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T17:58:18.517313+0000","last_undegraded":"2024-04-26T17:58:18.517313+0000","last_fullsized":"2024-04-26T17:58:18.517313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:26:03.981447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165731+0000","last_change":"2024-04-26T17:58:13.501631+0000","last_active":"2024-04-26T17:58:19.165731+0000","last_peered":"2024-04-26T17:58:19.165731+0000","last_clean":"2024-04-26T17:58:19.165731+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T17:58:19.165731+0000","last_undegraded":"2024-04-26T17:58:19.165731+0000","last_fullsized":"2024-04-26T17:58:19.165731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:45.448166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383409+0000","last_change":"2024-04-26T17:58:13.486414+0000","last_active":"2024-04-26T17:58:19.383409+0000","last_peered":"2024-04-26T17:58:19.383409+0000","last_clean":"2024-04-26T17:58:19.383409+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T17:58:19.383409+0000","last_undegraded":"2024-04-26T17:58:19.383409+0000","last_fullsized":"2024-04-26T17:58:19.383409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:29:18.722692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518153+0000","last_change":"2024-04-26T17:58:13.503639+0000","last_active":"2024-04-26T17:58:18.518153+0000","last_peered":"2024-04-26T17:58:18.518153+0000","last_clean":"2024-04-26T17:58:18.518153+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T17:58:18.518153+0000","last_undegraded":"2024-04-26T17:58:18.518153+0000","last_fullsized":"2024-04-26T17:58:18.518153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:29:52.512964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518311+0000","last_change":"2024-04-26T17:58:13.492593+0000","last_active":"2024-04-26T17:58:18.518311+0000","last_peered":"2024-04-26T17:58:18.518311+0000","last_clean":"2024-04-26T17:58:18.518311+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T17:58:18.518311+0000","last_undegraded":"2024-04-26T17:58:18.518311+0000","last_fullsized":"2024-04-26T17:58:18.518311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:12.707985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383564+0000","last_change":"2024-04-26T17:58:13.499845+0000","last_active":"2024-04-26T17:58:19.383564+0000","last_peered":"2024-04-26T17:58:19.383564+0000","last_clean":"2024-04-26T17:58:19.383564+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T17:58:19.383564+0000","last_undegraded":"2024-04-26T17:58:19.383564+0000","last_fullsized":"2024-04-26T17:58:19.383564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:22:01.821060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515609+0000","last_change":"2024-04-26T17:58:13.499915+0000","last_active":"2024-04-26T17:58:18.515609+0000","last_peered":"2024-04-26T17:58:18.515609+0000","last_clean":"2024-04-26T17:58:18.515609+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T17:58:18.515609+0000","last_undegraded":"2024-04-26T17:58:18.515609+0000","last_fullsized":"2024-04-26T17:58:18.515609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:49.681362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.383910+0000","last_change":"2024-04-26T17:58:13.496806+0000","last_active":"2024-04-26T17:58:19.383910+0000","last_peered":"2024-04-26T17:58:19.383910+0000","last_clean":"2024-04-26T17:58:19.383910+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T17:58:19.383910+0000","last_undegraded":"2024-04-26T17:58:19.383910+0000","last_fullsized":"2024-04-26T17:58:19.383910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:40:53.830386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.616019+0000","last_change":"2024-04-26T17:58:13.496351+0000","last_active":"2024-04-26T17:58:18.616019+0000","last_peered":"2024-04-26T17:58:18.616019+0000","last_clean":"2024-04-26T17:58:18.616019+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T17:58:18.616019+0000","last_undegraded":"2024-04-26T17:58:18.616019+0000","last_fullsized":"2024-04-26T17:58:18.616019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:33:00.640249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517561+0000","last_change":"2024-04-26T17:58:13.489875+0000","last_active":"2024-04-26T17:58:18.517561+0000","last_peered":"2024-04-26T17:58:18.517561+0000","last_clean":"2024-04-26T17:58:18.517561+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T17:58:18.517561+0000","last_undegraded":"2024-04-26T17:58:18.517561+0000","last_fullsized":"2024-04-26T17:58:18.517561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:03.286571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518525+0000","last_change":"2024-04-26T17:58:13.489817+0000","last_active":"2024-04-26T17:58:18.518525+0000","last_peered":"2024-04-26T17:58:18.518525+0000","last_clean":"2024-04-26T17:58:18.518525+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T17:58:18.518525+0000","last_undegraded":"2024-04-26T17:58:18.518525+0000","last_fullsized":"2024-04-26T17:58:18.518525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:44.708470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165790+0000","last_change":"2024-04-26T17:58:13.505849+0000","last_active":"2024-04-26T17:58:19.165790+0000","last_peered":"2024-04-26T17:58:19.165790+0000","last_clean":"2024-04-26T17:58:19.165790+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T17:58:19.165790+0000","last_undegraded":"2024-04-26T17:58:19.165790+0000","last_fullsized":"2024-04-26T17:58:19.165790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:37:18.642934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.385015+0000","last_change":"2024-04-26T17:58:13.502014+0000","last_active":"2024-04-26T17:58:19.385015+0000","last_peered":"2024-04-26T17:58:19.385015+0000","last_clean":"2024-04-26T17:58:19.385015+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T17:58:19.385015+0000","last_undegraded":"2024-04-26T17:58:19.385015+0000","last_fullsized":"2024-04-26T17:58:19.385015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:32.877488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165360+0000","last_change":"2024-04-26T17:58:13.505024+0000","last_active":"2024-04-26T17:58:19.165360+0000","last_peered":"2024-04-26T17:58:19.165360+0000","last_clean":"2024-04-26T17:58:19.165360+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T17:58:19.165360+0000","last_undegraded":"2024-04-26T17:58:19.165360+0000","last_fullsized":"2024-04-26T17:58:19.165360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:30:14.318622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.518527+0000","last_change":"2024-04-26T17:58:13.496626+0000","last_active":"2024-04-26T17:58:18.518527+0000","last_peered":"2024-04-26T17:58:18.518527+0000","last_clean":"2024-04-26T17:58:18.518527+0000","last_became_active":"2024-04-26T17:58:13.496002+0000","last_became_peered":"2024-04-26T17:58:13.496002+0000","last_unstale":"2024-04-26T17:58:18.518527+0000","last_undegraded":"2024-04-26T17:58:18.518527+0000","last_fullsized":"2024-04-26T17:58:18.518527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:44:50.482304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165226+0000","last_change":"2024-04-26T17:58:13.500991+0000","last_active":"2024-04-26T17:58:19.165226+0000","last_peered":"2024-04-26T17:58:19.165226+0000","last_clean":"2024-04-26T17:58:19.165226+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T17:58:19.165226+0000","last_undegraded":"2024-04-26T17:58:19.165226+0000","last_fullsized":"2024-04-26T17:58:19.165226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:19:26.539547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.517884+0000","last_change":"2024-04-26T17:58:13.504621+0000","last_active":"2024-04-26T17:58:18.517884+0000","last_peered":"2024-04-26T17:58:18.517884+0000","last_clean":"2024-04-26T17:58:18.517884+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T17:58:18.517884+0000","last_undegraded":"2024-04-26T17:58:18.517884+0000","last_fullsized":"2024-04-26T17:58:18.517884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:23.543561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:18.515770+0000","last_change":"2024-04-26T17:58:13.490926+0000","last_active":"2024-04-26T17:58:18.515770+0000","last_peered":"2024-04-26T17:58:18.515770+0000","last_clean":"2024-04-26T17:58:18.515770+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T17:58:18.515770+0000","last_undegraded":"2024-04-26T17:58:18.515770+0000","last_fullsized":"2024-04-26T17:58:18.515770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:57.550356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.384770+0000","last_change":"2024-04-26T17:58:13.502839+0000","last_active":"2024-04-26T17:58:19.384770+0000","last_peered":"2024-04-26T17:58:19.384770+0000","last_clean":"2024-04-26T17:58:19.384770+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T17:58:19.384770+0000","last_undegraded":"2024-04-26T17:58:19.384770+0000","last_fullsized":"2024-04-26T17:58:19.384770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:17:57.679033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T17:58:19.165705+0000","last_change":"2024-04-26T17:58:13.506881+0000","last_active":"2024-04-26T17:58:19.165705+0000","last_peered":"2024-04-26T17:58:19.165705+0000","last_clean":"2024-04-26T17:58:19.165705+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T17:58:19.165705+0000","last_undegraded":"2024-04-26T17:58:19.165705+0000","last_fullsized":"2024-04-26T17:58:19.165705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:10:39.011386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T17:58:50.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:50.415 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.416+0000 7f4ae71e4640 1 Processor -- start 2024-04-26T17:58:50.416 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.416+0000 7f4ae71e4640 1 -- start start 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae71e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cc2f0 0x7f4ae00ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae71e4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ae00cea70 0x7f4ae00d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae71e4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ae00cc8d0 con 0x7f4ae0156060 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae71e4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4ae00c68e0 con 0x7f4ae00cea70 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae71e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae0156440 con 0x7f4ae00cc2f0 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae5781640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4ae00cea70 0x7f4ae00d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae4f80640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4ae0156060 0x7f4ae015c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56590/0 (socket says 172.21.15.12:56590) 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae4f80640 1 -- 172.21.15.12:0/583776718 learned_addr learned my addr 172.21.15.12:0/583776718 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4adffff640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cc2f0 0x7f4ae00ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae5781640 1 -- 172.21.15.12:0/583776718 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cc2f0 msgr2=0x7f4ae00ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae5781640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cc2f0 0x7f4ae00ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae5781640 1 -- 172.21.15.12:0/583776718 >> v1:172.21.15.12:6789/0 conn(0x7f4ae0156060 legacy=0x7f4ae015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.417+0000 7f4ae5781640 1 -- 172.21.15.12:0/583776718 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae00c6320 con 0x7f4ae00cea70 2024-04-26T17:58:50.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.418+0000 7f4ae5781640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae00cea70 0x7f4ae00d1280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828bab3c350184cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.418+0000 7f4adf7fe640 1 -- 172.21.15.12:0/583776718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0037070 con 0x7f4ae00cea70 2024-04-26T17:58:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.418+0000 7f4adf7fe640 1 -- 172.21.15.12:0/583776718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad002ae50 con 0x7f4ae00cea70 2024-04-26T17:58:50.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.418+0000 7f4adf7fe640 1 -- 172.21.15.12:0/583776718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0032660 con 0x7f4ae00cea70 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 -- 172.21.15.12:0/583776718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae00cea70 msgr2=0x7f4ae00d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae00cea70 0x7f4ae00d1280 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00097a0 tx=0x7f4ad002a100 comp rx=0 tx=0).stop 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 -- 172.21.15.12:0/583776718 shutdown_connections 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae00cea70 0x7f4ae00d1280 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/583776718 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cc2f0 0x7f4ae00ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 -- 172.21.15.12:0/583776718 >> 172.21.15.12:0/583776718 conn(0x7f4ae0068090 msgr2=0x7f4ae00684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 -- 172.21.15.12:0/583776718 shutdown_connections 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.419+0000 7f4ae71e4640 1 -- 172.21.15.12:0/583776718 wait complete. 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.420+0000 7f4ae71e4640 1 Processor -- start 2024-04-26T17:58:50.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.420+0000 7f4ae71e4640 1 -- start start 2024-04-26T17:58:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae00cc2f0 0x7f4ae0153f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cea70 0x7f4ae01f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00ce010 con 0x7f4ae0156060 2024-04-26T17:58:50.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae00cdd30 con 0x7f4ae00cc2f0 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae71e4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4ae00c6d20 con 0x7f4ae00cea70 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47062/0 (socket says 172.21.15.12:47062) 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 -- 172.21.15.12:0/2778631583 learned_addr learned my addr 172.21.15.12:0/2778631583 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4adffff640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cea70 0x7f4ae01f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae4f80640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae00cc2f0 0x7f4ae0153f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 -- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cea70 msgr2=0x7f4ae01f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cea70 0x7f4ae01f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 -- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae00cc2f0 msgr2=0x7f4ae0153f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae00cc2f0 0x7f4ae0153f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.421+0000 7f4ae5781640 1 -- 172.21.15.12:0/2778631583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae014c6f0 con 0x7f4ae0156060 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4ae5781640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098c0 tx=0x7f4ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0041020 con 0x7f4ae0156060 2024-04-26T17:58:50.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad003c670 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0037040 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae014c9d0 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.422+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae0153a60 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.423+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae00c7e70 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.423+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ad0044020 con 0x7f4ae0156060 2024-04-26T17:58:50.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.424+0000 7f4add7fa640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 0x7f4ac006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.424+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4ad00ac460 con 0x7f4ae0156060 2024-04-26T17:58:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.424+0000 7f4ae4f80640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 0x7f4ac006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.425+0000 7f4ae4f80640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 0x7f4ac006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80012e0 tx=0x7f4ad8001a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.428+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4ae00c7e70 con 0x7f4ae0156060 2024-04-26T17:58:50.654 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.655+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ae0076d20 con 0x7f4ae0156060 2024-04-26T17:58:50.655 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.656+0000 7f4add7fa640 1 -- 172.21.15.12:0/2778631583 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f4ad004b030 con 0x7f4ae0156060 2024-04-26T17:58:50.655 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:50.655 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:50.656 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 msgr2=0x7f4ac006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 0x7f4ac006edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4ad80012e0 tx=0x7f4ad8001a30 comp rx=0 tx=0).stop 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 msgr2=0x7f4ae01f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00098c0 tx=0x7f4ad00046c0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 shutdown_connections 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4ae0156060 0x7f4ae01f5a30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4ac006c8f0 0x7f4ac006edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.658 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4ae00cea70 0x7f4ae01f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 --2- 172.21.15.12:0/2778631583 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ae00cc2f0 0x7f4ae0153f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 >> 172.21.15.12:0/2778631583 conn(0x7f4ae0068090 msgr2=0x7f4ae0151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 shutdown_connections 2024-04-26T17:58:50.659 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.658+0000 7f4ae71e4640 1 -- 172.21.15.12:0/2778631583 wait complete. 2024-04-26T17:58:50.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:50.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.771+0000 7f45fab51640 1 Processor -- start 2024-04-26T17:58:50.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.771+0000 7f45fab51640 1 -- start start 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45fab51640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f45f406e240 0x7f45f40c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45fab51640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f40c7d30 con 0x7f45f415ce60 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45fab51640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f40c7ff0 con 0x7f45f4153b10 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45fab51640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f45f406e8d0 con 0x7f45f406e240 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45f90ee640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f45f415ce60 0x7f45f415d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56598/0 (socket says 172.21.15.12:56598) 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45f90ee640 1 -- 172.21.15.12:0/1639700030 learned_addr learned my addr 172.21.15.12:0/1639700030 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45f3fff640 1 --2- 172.21.15.12:0/1639700030 >> v2:172.21.15.100:3300/0 conn(0x7f45f406e240 0x7f45f40c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653756786 0 0) 0x7f45f40c7d30 con 0x7f45f415ce60 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.772+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45dc003520 con 0x7f45f415ce60 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890416471 0 0) 0x7f45f40c7ff0 con 0x7f45f4153b10 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45f40c7d30 con 0x7f45f4153b10 2024-04-26T17:58:50.773 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232127127 0 0) 0x7f45dc003520 con 0x7f45f415ce60 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f3fff640 1 -- 172.21.15.12:0/1639700030 >> v1:172.21.15.100:6789/0 conn(0x7f45f4153b10 legacy=0x7f45f40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f3fff640 1 -- 172.21.15.12:0/1639700030 >> v1:172.21.15.12:6789/0 conn(0x7f45f415ce60 legacy=0x7f45f415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.773+0000 7f45f3fff640 1 -- 172.21.15.12:0/1639700030 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f4072fe0 con 0x7f45f406e240 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45f3fff640 1 --2- 172.21.15.12:0/1639700030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f406e240 0x7f45f40c96d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e97895f4319af626 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8037070 con 0x7f45f406e240 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e802ace0 con 0x7f45f406e240 2024-04-26T17:58:50.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45f37fe640 1 -- 172.21.15.12:0/1639700030 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4001670 con 0x7f45f406e240 2024-04-26T17:58:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 -- 172.21.15.12:0/1639700030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f406e240 msgr2=0x7f45f40c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 --2- 172.21.15.12:0/1639700030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f406e240 0x7f45f40c96d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f45e80097a0 tx=0x7f45e802a250 comp rx=0 tx=0).stop 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 -- 172.21.15.12:0/1639700030 shutdown_connections 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 --2- 172.21.15.12:0/1639700030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f406e240 0x7f45f40c96d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 -- 172.21.15.12:0/1639700030 >> 172.21.15.12:0/1639700030 conn(0x7f45f4068270 msgr2=0x7f45f4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 -- 172.21.15.12:0/1639700030 shutdown_connections 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.774+0000 7f45fab51640 1 -- 172.21.15.12:0/1639700030 wait complete. 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.775+0000 7f45fab51640 1 Processor -- start 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.775+0000 7f45fab51640 1 -- start start 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45f4153b10 0x7f45f413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f415ce60 0x7f45f4147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40735a0 con 0x7f45f406e240 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f45f4073910 con 0x7f45f415ce60 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45fab51640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f45f4153ef0 con 0x7f45f4153b10 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45f88ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45f88ed640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47066/0 (socket says 172.21.15.12:47066) 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45f88ed640 1 -- 172.21.15.12:0/2061895709 learned_addr learned my addr 172.21.15.12:0/2061895709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.776+0000 7f45f90ee640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f415ce60 0x7f45f4147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f3fff640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45f4153b10 0x7f45f413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 -- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45f4153b10 msgr2=0x7f45f413b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45f4153b10 0x7f45f413b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 -- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f415ce60 msgr2=0x7f45f4147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f415ce60 0x7f45f4147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 -- 172.21.15.12:0/2061895709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f415aa30 con 0x7f45f406e240 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f88ed640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c800 tx=0x7f45ec00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec003b70 con 0x7f45f406e240 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec003d10 con 0x7f45f406e240 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f4149220 con 0x7f45f406e240 2024-04-26T17:58:50.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00aa90 con 0x7f45f406e240 2024-04-26T17:58:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.777+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f40cb730 con 0x7f45f406e240 2024-04-26T17:58:50.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.778+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4076d20 con 0x7f45f406e240 2024-04-26T17:58:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.779+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45ec00ac30 con 0x7f45f406e240 2024-04-26T17:58:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.779+0000 7f45f17fa640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.779+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f45ec08bda0 con 0x7f45f406e240 2024-04-26T17:58:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.779+0000 7f45f3fff640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:50.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.780+0000 7f45f3fff640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034000 tx=0x7f45e802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:50.782 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:50.784+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f45ec059840 con 0x7f45f406e240 2024-04-26T17:58:51.009 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.010+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45f4149cf0 con 0x7f45f406e240 2024-04-26T17:58:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.011+0000 7f45f17fa640 1 -- 172.21.15.12:0/2061895709 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f45ec05db40 con 0x7f45f406e240 2024-04-26T17:58:51.010 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:51.010 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:51.010 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.012+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 msgr2=0x7f45e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.012+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 0x7f45e006edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f45e8034000 tx=0x7f45e802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 msgr2=0x7f45f413d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00c800 tx=0x7f45ec00ccc0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 shutdown_connections 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45f415ce60 0x7f45f4147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f45e006c8f0 0x7f45e006edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f45f4153b10 0x7f45f413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 --2- 172.21.15.12:0/2061895709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45f406e240 0x7f45f413d960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 >> 172.21.15.12:0/2061895709 conn(0x7f45f4068270 msgr2=0x7f45f41529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 shutdown_connections 2024-04-26T17:58:51.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.013+0000 7f45fab51640 1 -- 172.21.15.12:0/2061895709 wait complete. 2024-04-26T17:58:51.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T17:58:51.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.124+0000 7fb2c4aa0640 1 Processor -- start 2024-04-26T17:58:51.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.124+0000 7fb2c4aa0640 1 -- start start 2024-04-26T17:58:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb2c0155da0 0x7fb2c015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c0156180 0x7fb2c00d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 0x7fb2c00d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c015cbc0 con 0x7fb2c0155da0 2024-04-26T17:58:51.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c00cc730 con 0x7fb2c00cd840 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2c4aa0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c015f2a0 con 0x7fb2c0156180 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2be59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb2c0155da0 0x7fb2c015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2be59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb2c0155da0 0x7fb2c015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47068/0 (socket says 172.21.15.12:47068) 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2be59c640 1 -- 172.21.15.12:0/4123104702 learned_addr learned my addr 172.21.15.12:0/4123104702 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2bdd9b640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c0156180 0x7fb2c00d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2bed9d640 1 --2- 172.21.15.12:0/4123104702 >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 0x7fb2c00d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.125+0000 7fb2be59c640 1 -- 172.21.15.12:0/4123104702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c0156180 msgr2=0x7fb2c00d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2be59c640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c0156180 0x7fb2c00d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2be59c640 1 -- 172.21.15.12:0/4123104702 >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 msgr2=0x7fb2c00d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2be59c640 1 --2- 172.21.15.12:0/4123104702 >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 0x7fb2c00d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2be59c640 1 -- 172.21.15.12:0/4123104702 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c015f580 con 0x7fb2c0155da0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2bed9d640 1 --2- 172.21.15.12:0/4123104702 >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 0x7fb2c00d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2be59c640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c015c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00d20f0 tx=0x7fb2b802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f1b9a4b7e082bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2bd59a640 1 -- 172.21.15.12:0/4123104702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8037070 con 0x7fb2c0155da0 2024-04-26T17:58:51.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2bd59a640 1 -- 172.21.15.12:0/4123104702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8032440 con 0x7fb2c0155da0 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.126+0000 7fb2bd59a640 1 -- 172.21.15.12:0/4123104702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8032810 con 0x7fb2c0155da0 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/4123104702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 msgr2=0x7fb2c015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c015c680 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00d20f0 tx=0x7fb2b802a140 comp rx=0 tx=0).stop 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/4123104702 shutdown_connections 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/4123104702 >> v2:172.21.15.100:3300/0 conn(0x7fb2c00cd840 0x7fb2c00d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c0156180 0x7fb2c00d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/4123104702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c015c680 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/4123104702 >> 172.21.15.12:0/4123104702 conn(0x7fb2c0068090 msgr2=0x7fb2c00684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/4123104702 shutdown_connections 2024-04-26T17:58:51.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.127+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/4123104702 wait complete. 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.128+0000 7fb2c4aa0640 1 Processor -- start 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.128+0000 7fb2c4aa0640 1 -- start start 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c00cd840 0x7fb2c00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c014c050 0x7fb2c01503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c00cc160 con 0x7fb2c0155da0 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c015fb40 con 0x7fb2c00cd840 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2c4aa0640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c00cc2e0 con 0x7fb2c014c050 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2bdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2bdd9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47074/0 (socket says 172.21.15.12:47074) 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2bdd9b640 1 -- 172.21.15.12:0/1666759068 learned_addr learned my addr 172.21.15.12:0/1666759068 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2bed9d640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c014c050 0x7fb2c01503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.129+0000 7fb2be59c640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c00cd840 0x7fb2c00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 -- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c014c050 msgr2=0x7fb2c01503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c014c050 0x7fb2c01503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 -- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c00cd840 msgr2=0x7fb2c00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c00cd840 0x7fb2c00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 -- 172.21.15.12:0/1666759068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c0157290 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2bdd9b640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d830 tx=0x7fb2a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800b6c0 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a8019070 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c014c500 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a800ba80 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.130+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c01569f0 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.131+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c0076d20 con 0x7fb2c0155da0 2024-04-26T17:58:51.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.132+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2a801e460 con 0x7fb2c0155da0 2024-04-26T17:58:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.132+0000 7fb2b6ffd640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 0x7fb2a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.132+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb2a808c390 con 0x7fb2c0155da0 2024-04-26T17:58:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.132+0000 7fb2be59c640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 0x7fb2a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.133+0000 7fb2be59c640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 0x7fb2a006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.135 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.137+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2a8059db0 con 0x7fb2c0155da0 2024-04-26T17:58:51.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.323+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2c01f5570 con 0x7fb2c0155da0 2024-04-26T17:58:51.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.324+0000 7fb2b6ffd640 1 -- 172.21.15.12:0/1666759068 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fb2a805e0b0 con 0x7fb2c0155da0 2024-04-26T17:58:51.323 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:51.323 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":24,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T17:58:17.890429+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T17:58:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 msgr2=0x7fb2a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 0x7fb2a006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8034000 tx=0x7fb2b802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 msgr2=0x7fb2c01597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d830 tx=0x7fb2a800dcf0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 shutdown_connections 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb2a006c920 0x7fb2a006ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb2c014c050 0x7fb2c01503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2c0155da0 0x7fb2c01597c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 --2- 172.21.15.12:0/1666759068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb2c00cd840 0x7fb2c00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 >> 172.21.15.12:0/1666759068 conn(0x7fb2c0068090 msgr2=0x7fb2c00d1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 shutdown_connections 2024-04-26T17:58:51.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.326+0000 7fb2c4aa0640 1 -- 172.21.15.12:0/1666759068 wait complete. 2024-04-26T17:58:51.336 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-04-26T17:58:51.444 INFO:teuthology.orchestra.run.smithi012.stdout:{"run_dir":"/var/run/ceph"} 2024-04-26T17:58:51.444 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-04-26T17:58:51.444 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 9496 2024-04-26T17:58:51.445 DEBUG:tasks.quiescer:Yielding 2024-04-26T17:58:51.445 INFO:teuthology.run_tasks:Running task workunit... 2024-04-26T17:58:51.457 INFO:tasks.workunit:Pulling workunits from ref bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:58:51.458 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-26T17:58:51.458 INFO:tasks.workunit:timeout=6h 2024-04-26T17:58:51.458 INFO:tasks.workunit:cleanup=True 2024-04-26T17:58:51.458 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:51.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-26T17:58:51.474 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2024-04-26 17:58:18.480529721 +0000 2024-04-26T17:58:51.475 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2024-04-26 17:58:28.305471259 +0000 2024-04-26T17:58:51.475 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: 2024-04-26 17:58:18.480529721 +0000 2024-04-26T17:58:51.475 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-26T17:58:51.475 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-26T17:58:51.542 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 2024-04-26T17:58:51.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.560+0000 7f9fb9209640 1 Processor -- start 2024-04-26T17:58:51.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.561+0000 7f9fb9209640 1 -- start start 2024-04-26T17:58:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.561+0000 7f9fb9209640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fb40c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.561+0000 7f9fb9209640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb40ccd90 con 0x7f9fb415f7e0 2024-04-26T17:58:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.561+0000 7f9fb9209640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fb415bfe0 con 0x7f9fb40cb680 2024-04-26T17:58:51.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.561+0000 7f9fb9209640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb41560e0 con 0x7f9fb4155d00 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb359e640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9fb415f7e0 0x7f9fb4166520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56600/0 (socket says 172.21.15.12:56600) 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb359e640 1 -- 172.21.15.12:0/2379726675 learned_addr learned my addr 172.21.15.12:0/2379726675 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb2d9d640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fb40c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877474140 0 0) 0x7f9fac001490 con 0x7f9fb415f7e0 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa0003520 con 0x7f9fb415f7e0 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732102729 0 0) 0x7f9fb415bfe0 con 0x7f9fb40cb680 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fac001490 con 0x7f9fb40cb680 2024-04-26T17:58:51.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2761079302 0 0) 0x7f9fa0003520 con 0x7f9fb415f7e0 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 msgr2=0x7f9fb40c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fb40c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 >> v1:172.21.15.100:6789/0 conn(0x7f9fb40cb680 legacy=0x7f9fb406fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb415c2c0 con 0x7f9fb415f7e0 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f9fac001bc0 con 0x7f9fb415f7e0 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 >> v1:172.21.15.12:6789/0 conn(0x7f9fb415f7e0 legacy=0x7f9fb4166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fa0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fa00040d0 0x7f9fa0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0004d40 0x7f9fa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb41560e0 con 0x7f9fa0004d40 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa000baa0 con 0x7f9fa00040d0 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa000bca0 con 0x7f9fb4155d00 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0004d40 0x7f9fa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fb2d9d640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fa0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.562+0000 7f9fabfff640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fa00040d0 0x7f9fa0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 -- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 msgr2=0x7f9fa0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb4155d00 0x7f9fa0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 -- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fa00040d0 msgr2=0x7f9fa0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fa00040d0 0x7f9fa0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 -- 172.21.15.12:0/2379726675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa0003520 con 0x7f9fa0004d40 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.563+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0004d40 0x7f9fa00051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00a9d0 tx=0x7f9fa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d249905c6e2bdb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00a5f0 con 0x7f9fa0004d40 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac02f070 con 0x7f9fa0004d40 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb259c640 1 -- 172.21.15.12:0/2379726675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac02be50 con 0x7f9fa0004d40 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 -- 172.21.15.12:0/2379726675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0004d40 msgr2=0x7f9fa00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.575 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2379726675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fa0004d40 0x7f9fa00051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00a9d0 tx=0x7f9fa0005830 comp rx=0 tx=0).stop 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb359e640 1 -- 172.21.15.12:0/2379726675 reap_dead start 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 -- 172.21.15.12:0/2379726675 shutdown_connections 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 -- 172.21.15.12:0/2379726675 >> 172.21.15.12:0/2379726675 conn(0x7f9fb4071bf0 msgr2=0x7f9fb4071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 -- 172.21.15.12:0/2379726675 shutdown_connections 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.564+0000 7f9fb9209640 1 -- 172.21.15.12:0/2379726675 wait complete. 2024-04-26T17:58:51.576 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.565+0000 7f9fb9209640 1 Processor -- start 2024-04-26T17:58:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 -- start start 2024-04-26T17:58:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb41e5530 0x7f9fb415e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb41e5910 0x7f9fb41f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.577 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb415c880 con 0x7f9fb415d900 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb415cb60 con 0x7f9fb41e5530 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb9209640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f9fb415f2c0 con 0x7f9fb41e5910 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47102/0 (socket says 172.21.15.12:47102) 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb359e640 1 -- 172.21.15.12:0/2001940657 learned_addr learned my addr 172.21.15.12:0/2001940657 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:51.578 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fabfff640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb41e5910 0x7f9fb41f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.566+0000 7f9fb2d9d640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb41e5530 0x7f9fb415e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 -- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb41e5910 msgr2=0x7f9fb41f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb41e5910 0x7f9fb41f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 -- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb41e5530 msgr2=0x7f9fb415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.579 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb41e5530 0x7f9fb415e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 -- 172.21.15.12:0/2001940657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb415d170 con 0x7f9fb415d900 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb359e640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00a9d0 tx=0x7f9fb415c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00a5f0 con 0x7f9fb415d900 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fac034880 con 0x7f9fb415d900 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac034c30 con 0x7f9fb415d900 2024-04-26T17:58:51.580 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb41e4a70 con 0x7f9fb415d900 2024-04-26T17:58:51.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.567+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb41e4ff0 con 0x7f9fb415d900 2024-04-26T17:58:51.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.568+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb40ca0f0 con 0x7f9fb415d900 2024-04-26T17:58:51.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.569+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9fac007070 con 0x7f9fb415d900 2024-04-26T17:58:51.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.569+0000 7f9fab7fe640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:51.581 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.569+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9fac0ac650 con 0x7f9fb415d900 2024-04-26T17:58:51.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.569+0000 7f9fb2d9d640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:51.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.570+0000 7f9fb2d9d640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009bc0 tx=0x7f9fa4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:51.582 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.574+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9fb40ca0f0 con 0x7f9fb415d900 2024-04-26T17:58:51.583 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-26T17:58:51.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.798+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb4076d20 con 0x7f9fb415d900 2024-04-26T17:58:51.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.798+0000 7f9fab7fe640 1 -- 172.21.15.12:0/2001940657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f9fb40ccd90 con 0x7f9fb415d900 2024-04-26T17:58:51.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:58:51.799 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 msgr2=0x7f9f9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 0x7f9f9406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009bc0 tx=0x7f9fa4009190 comp rx=0 tx=0).stop 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 msgr2=0x7f9fb415ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00a9d0 tx=0x7f9fb415c1b0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 shutdown_connections 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb415d900 0x7f9fb415ddb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f9f9406c8f0 0x7f9f9406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f9fb41e5910 0x7f9fb41f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 --2- 172.21.15.12:0/2001940657 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9fb41e5530 0x7f9fb415e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 >> 172.21.15.12:0/2001940657 conn(0x7f9fb4071bf0 msgr2=0x7f9fb40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 shutdown_connections 2024-04-26T17:58:51.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:51.800+0000 7f9fb9209640 1 -- 172.21.15.12:0/2001940657 wait complete. 2024-04-26T17:58:52.414 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T17:58:12.845520+0000', 'modified': '2024-04-26T17:58:37.922040+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6839/3743641599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3743641599}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3743641599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-04-26T17:58:52.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T17:58:52.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-26T17:58:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.521+0000 7f05ae420640 1 Processor -- start 2024-04-26T17:58:52.521 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 -- start start 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05a8155da0 0x7f05a815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05a815ffd0 con 0x7f05a80d12e0 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f05a80cd8b0 con 0x7f05a8155da0 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ae420640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f05a80cc490 con 0x7f05a80c63b0 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05a7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05a8155da0 0x7f05a815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05a7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f05a8155da0 0x7f05a815fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47118/0 (socket says 172.21.15.12:47118) 2024-04-26T17:58:52.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05a7fff640 1 -- 172.21.15.12:0/3002699141 learned_addr learned my addr 172.21.15.12:0/3002699141 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.522+0000 7f05ac9bd640 1 --1- 172.21.15.12:0/3002699141 >> v1:172.21.15.12:6789/0 conn(0x7f05a80d12e0 0x7f05a815bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56608/0 (socket says 172.21.15.12:56608) 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a7fff640 1 -- 172.21.15.12:0/3002699141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 msgr2=0x7f05a80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a7fff640 1 -- 172.21.15.12:0/3002699141 >> v1:172.21.15.12:6789/0 conn(0x7f05a80d12e0 legacy=0x7f05a815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a7fff640 1 -- 172.21.15.12:0/3002699141 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a80cc770 con 0x7f05a8155da0 2024-04-26T17:58:52.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.523+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8155da0 0x7f05a815fa90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe81438b372237a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05a6ffd640 1 -- 172.21.15.12:0/3002699141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598037070 con 0x7f05a8155da0 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05a6ffd640 1 -- 172.21.15.12:0/3002699141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0598032440 con 0x7f05a8155da0 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05a6ffd640 1 -- 172.21.15.12:0/3002699141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598032810 con 0x7f05a8155da0 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 -- 172.21.15.12:0/3002699141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8155da0 msgr2=0x7f05a815fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8155da0 0x7f05a815fa90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0598009870 tx=0x7f059802a270 comp rx=0 tx=0).stop 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 -- 172.21.15.12:0/3002699141 shutdown_connections 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 --2- 172.21.15.12:0/3002699141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a8155da0 0x7f05a815fa90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 -- 172.21.15.12:0/3002699141 >> 172.21.15.12:0/3002699141 conn(0x7f05a8068090 msgr2=0x7f05a80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 -- 172.21.15.12:0/3002699141 shutdown_connections 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.524+0000 7f05ae420640 1 -- 172.21.15.12:0/3002699141 wait complete. 2024-04-26T17:58:52.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.525+0000 7f05ae420640 1 Processor -- start 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 -- start start 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a8155da0 0x7f05a814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05a80ce0c0 con 0x7f05a80d12e0 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f05a80cdde0 con 0x7f05a8155da0 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05ae420640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f05a8156180 con 0x7f05a80c63b0 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47134/0 (socket says 172.21.15.12:47134) 2024-04-26T17:58:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.526+0000 7f05a77fe640 1 -- 172.21.15.12:0/3437728881 learned_addr learned my addr 172.21.15.12:0/3437728881 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a8155da0 0x7f05a814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 -- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 msgr2=0x7f05a80b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 -- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a8155da0 msgr2=0x7f05a814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a8155da0 0x7f05a814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 -- 172.21.15.12:0/3437728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a81f2420 con 0x7f05a80d12e0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c7f0 tx=0x7f059c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a4ff9640 1 -- 172.21.15.12:0/3437728881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c015070 con 0x7f05a80d12e0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a4ff9640 1 -- 172.21.15.12:0/3437728881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c007a30 con 0x7f05a80d12e0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05a80b6f70 con 0x7f05a80d12e0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05a4ff9640 1 -- 172.21.15.12:0/3437728881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c007e00 con 0x7f05a80d12e0 2024-04-26T17:58:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.527+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05a81f5200 con 0x7f05a80d12e0 2024-04-26T17:58:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.528+0000 7f05a4ff9640 1 -- 172.21.15.12:0/3437728881 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f059c018070 con 0x7f05a80d12e0 2024-04-26T17:58:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.529+0000 7f05a4ff9640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 0x7f059406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.529+0000 7f05a4ff9640 1 -- 172.21.15.12:0/3437728881 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f059c08bde0 con 0x7f05a80d12e0 2024-04-26T17:58:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.529+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 0x7f059406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 0x7f059406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0598034000 tx=0x7f059802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 Processor -- start 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 -- start start 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a53830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 0x5610f2a38370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5610f2973740 con 0x5610f2a0ab20 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610f290f3a0 con 0x5610f2a37f90 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5610f296f700 con 0x5610f2a0cf70 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47136/0 (socket says 172.21.15.12:47136) 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.530+0000 7f05a77fe640 1 -- 172.21.15.12:0/467778087 learned_addr learned my addr 172.21.15.12:0/467778087 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a7fff640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a53830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 0x5610f2a38370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 -- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 msgr2=0x5610f2a38370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 0x5610f2a38370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 -- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 msgr2=0x5610f2a53830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a53830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 -- 172.21.15.12:0/467778087 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f292b750 con 0x5610f2a0ab20 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 0x5610f2a38370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f05a77fe640 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f059c061f10 tx=0x7f059c0592f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e30d08d4cd4d05f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f058dffb640 1 -- 172.21.15.12:0/467778087 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c01f070 con 0x5610f2a0ab20 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f058dffb640 1 -- 172.21.15.12:0/467778087 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c0600c0 con 0x5610f2a0ab20 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.531+0000 7f058dffb640 1 -- 172.21.15.12:0/467778087 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c055ed0 con 0x5610f2a0ab20 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- 172.21.15.12:0/467778087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 msgr2=0x5610f2a0ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f059c061f10 tx=0x7f059c0592f0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- 172.21.15.12:0/467778087 shutdown_connections 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a0cf70 0x5610f2a38370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a0ab20 0x5610f2a0ca30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 --2- 172.21.15.12:0/467778087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a53830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.533 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- 172.21.15.12:0/467778087 >> 172.21.15.12:0/467778087 conn(0x5610f2a0b9b0 msgr2=0x5610f2a52e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- 172.21.15.12:0/467778087 shutdown_connections 2024-04-26T17:58:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- 172.21.15.12:0/467778087 wait complete. 2024-04-26T17:58:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 -- start start 2024-04-26T17:58:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.532+0000 7f05b1212740 1 Processor -- start 2024-04-26T17:58:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a0f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a35640 0x5610f2a349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5610f2a0afb0 con 0x5610f2a4a180 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610f28fafe0 con 0x5610f2a37f90 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5610f2a11090 con 0x5610f2a35640 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05b1212740 10 client.0 _ll_register_callbacks cb 0x5610f2911150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05a77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47150/0 (socket says 172.21.15.12:47150) 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05a77fe640 1 -- 172.21.15.12:0/1729297670 learned_addr learned my addr 172.21.15.12:0/1729297670 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a35640 0x5610f2a349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.533+0000 7f05a7fff640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a0f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 -- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a35640 msgr2=0x5610f2a349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a35640 0x5610f2a349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 -- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 msgr2=0x5610f2a0f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.538 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a0f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 -- 172.21.15.12:0/1729297670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f26852d0 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a7fff640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05a77fe640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f059c059a20 tx=0x7f059c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8b90e9d78374c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059c077060 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f059c078bf0 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f059c0600c0 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f059c088030 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 10 client.4791 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5610f274f6b0 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f059c0600c0 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f059c05ab90 con 0x5610f2a4a180 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 10 client.4791 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:52.539 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 20 client.4791 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a6ceb0 0x5610f2a6f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 4 client.4791 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.534+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610f2981350 con 0x5610f2a6ceb0 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.535+0000 7f05a7fff640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a6ceb0 0x5610f2a6f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.535+0000 7f05a7fff640 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a6ceb0 0x5610f2a6f2a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea2dede13215d6e server_cookie=6bc50f7efde62e80 in_seq=0 out_seq=0 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.535+0000 7f0586ffd640 10 client.4791 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f0586ffd640 1 -- 172.21.15.12:0/1729297670 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5610f2981350 con 0x5610f2a6ceb0 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f0586ffd640 10 client.4791 handle_command_reply: tid=0 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 client.4791 shutdown 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 msgr2=0x5610f2a60b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f059c059a20 tx=0x7f059c000bc0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 shutdown_connections 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a35640 0x5610f2a349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a4a180 0x5610f2a60b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.540 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a6ceb0 0x5610f2a6f2a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 --2- 172.21.15.12:0/1729297670 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f0586ffd640 0 client.4791 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 >> 172.21.15.12:0/1729297670 conn(0x5610f2a0cf70 msgr2=0x5610f2a08670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 shutdown_connections 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 1 -- 172.21.15.12:0/1729297670 wait complete. 2024-04-26T17:58:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.536+0000 7f05b1212740 20 client.4791 trim_cache size 0 max 16384 2024-04-26T17:58:52.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.554+0000 7f05b1212740 1 Processor -- start 2024-04-26T17:58:52.553 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.554+0000 7f05b1212740 1 -- start start 2024-04-26T17:58:52.555 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a63480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2a639c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f05a81fe450 con 0x5610f2a35640 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610f2a11090 con 0x5610f2a37f90 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5610f2a0afb0 con 0x5610f2a4a180 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47158/0 (socket says 172.21.15.12:47158) 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 -- 172.21.15.12:0/3865066208 learned_addr learned my addr 172.21.15.12:0/3865066208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 -- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 msgr2=0x5610f2a639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2a639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 -- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 msgr2=0x5610f2a63480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a63480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 -- 172.21.15.12:0/3865066208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610f2a63fb0 con 0x5610f2a35640 2024-04-26T17:58:52.556 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0598009990 tx=0x7f059802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb80b5c4703bdc01 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.555+0000 7f058d7fa640 1 -- 172.21.15.12:0/3865066208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598037040 con 0x5610f2a35640 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f058d7fa640 1 -- 172.21.15.12:0/3865066208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0598053030 con 0x5610f2a35640 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f058d7fa640 1 -- 172.21.15.12:0/3865066208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059804f6a0 con 0x5610f2a35640 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 -- 172.21.15.12:0/3865066208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 msgr2=0x5610f2a60050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0598009990 tx=0x7f059802c000 comp rx=0 tx=0).stop 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 -- 172.21.15.12:0/3865066208 shutdown_connections 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2a639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 --2- 172.21.15.12:0/3865066208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a60050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 -- 172.21.15.12:0/3865066208 >> 172.21.15.12:0/3865066208 conn(0x5610f2a0cf70 msgr2=0x5610f2a347a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 -- 172.21.15.12:0/3865066208 shutdown_connections 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.556+0000 7f05b1212740 1 -- 172.21.15.12:0/3865066208 wait complete. 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 -- start start 2024-04-26T17:58:52.557 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 Processor -- start 2024-04-26T17:58:52.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a30ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2acd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5610f2a509d0 con 0x5610f2a35640 2024-04-26T17:58:52.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5610f28fafe0 con 0x5610f2a37f90 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5610f2a55c20 con 0x5610f2a4a180 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.557+0000 7f05b1212740 10 client.0 _ll_register_callbacks cb 0x7f0598035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47162/0 (socket says 172.21.15.12:47162) 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 -- 172.21.15.12:0/3939352202 learned_addr learned my addr 172.21.15.12:0/3939352202 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a30ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2acd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 -- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 msgr2=0x5610f2acd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2acd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 -- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 msgr2=0x5610f2a30ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a30ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 -- 172.21.15.12:0/3939352202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610f2a38fd0 con 0x5610f2a35640 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05ac9bd640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2acd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:52.562 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a30ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05a7fff640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0598009520 tx=0x7f0598004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a8ce234448290b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f0586ffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0598037040 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f059803e460 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0598053030 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f059804f920 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05b1212740 10 client.4797 fetch_fsmap learned FSMap version 9 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5610f2a4ca30 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.558+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0598053030 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f05980623a0 con 0x5610f2a35640 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 10 client.4797 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 20 client.4797 populate_metadata read hostname 'smithi012' 2024-04-26T17:58:52.563 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a5f410 0x5610f2ad75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 4 client.4797 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "status"}) -- 0x5610f297b1c0 con 0x5610f2a5f410 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a5f410 0x5610f2ad75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05a77fe640 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a5f410 0x5610f2ad75c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60cdc3bbc6a5323d server_cookie=ef5b7e6a0226904c in_seq=0 out_seq=0 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f0586ffd640 10 client.4797 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f0586ffd640 1 -- 172.21.15.12:0/3939352202 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5610f297b1c0 con 0x5610f2a5f410 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f0586ffd640 10 client.4797 handle_command_reply: tid=0 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.559+0000 7f05b1212740 1 client.4797 shutdown 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 msgr2=0x5610f2a63880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0598009520 tx=0x7f0598004730 comp rx=0 tx=0).stop 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 shutdown_connections 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5610f2a4a180 0x5610f2acd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5610f2a5f410 0x5610f2ad75c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5610f2a37f90 0x5610f2a30ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 --2- 172.21.15.12:0/3939352202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5610f2a35640 0x5610f2a63880 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f0586ffd640 0 client.4797 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 >> 172.21.15.12:0/3939352202 conn(0x5610f2a0cf70 msgr2=0x5610f2a0f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 shutdown_connections 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 1 -- 172.21.15.12:0/3939352202 wait complete. 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05b1212740 20 client.4797 trim_cache size 0 max 16384 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "68faa4ec-4899-41e7-bbbd-182baff15e13", 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4300, 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2024-04-26T17:58:52.565 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 39.080759977, 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 9, 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 24, 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 24, 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 45.113937356000001 2024-04-26T17:58:52.566 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 msgr2=0x7f059406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 0x7f059406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0598034000 tx=0x7f059802e000 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 msgr2=0x7f05a81f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f059c00c7f0 tx=0x7f059c00cbf0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 shutdown_connections 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f05a8155da0 0x7f05a814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05a80d12e0 0x7f05a81f4cc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f059406c8f0 0x7f059406edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 --2- 172.21.15.12:0/3437728881 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f05a80c63b0 0x7f05a80b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 >> 172.21.15.12:0/3437728881 conn(0x7f05a8068090 msgr2=0x7f05a80c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:58:52.567 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.560+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 shutdown_connections 2024-04-26T17:58:52.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:58:52.561+0000 7f05ae420640 1 -- 172.21.15.12:0/3437728881 wait complete. 2024-04-26T17:58:52.570 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-26T17:59:07.572 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T17:59:07.572 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T17:59:07.572 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.687+0000 7fc7a70ea640 1 Processor -- start 2024-04-26T17:59:07.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.687+0000 7fc7a70ea640 1 -- start start 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a70ea640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7a006e240 0x7fc7a00c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a70ea640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00c7d30 con 0x7fc7a015ce60 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a70ea640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a00c7ff0 con 0x7fc7a0153b10 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a70ea640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fc7a006e8d0 con 0x7fc7a006e240 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc79ffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc7a006e240 0x7fc7a00c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a5687640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc7a015ce60 0x7fc7a015d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60974/0 (socket says 172.21.15.12:60974) 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc7a5687640 1 -- 172.21.15.12:0/4065385582 learned_addr learned my addr 172.21.15.12:0/4065385582 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc79ffff640 1 --2- 172.21.15.12:0/4065385582 >> v2:172.21.15.12:3300/0 conn(0x7fc7a006e240 0x7fc7a00c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38464/0 (socket says 172.21.15.12:38464) 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc79ffff640 1 -- 172.21.15.12:0/4065385582 >> v1:172.21.15.100:6789/0 conn(0x7fc7a0153b10 legacy=0x7fc7a00cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc79ffff640 1 -- 172.21.15.12:0/4065385582 >> v1:172.21.15.12:6789/0 conn(0x7fc7a015ce60 legacy=0x7fc7a015d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.688+0000 7fc79ffff640 1 -- 172.21.15.12:0/4065385582 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a0072fe0 con 0x7fc7a006e240 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.689+0000 7fc79ffff640 1 --2- 172.21.15.12:0/4065385582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a006e240 0x7fc7a00c96d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097a0 tx=0x7fc78c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc26a492c97696f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.689+0000 7fc79f7fe640 1 -- 172.21.15.12:0/4065385582 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c037070 con 0x7fc7a006e240 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.689+0000 7fc79f7fe640 1 -- 172.21.15.12:0/4065385582 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c032440 con 0x7fc7a006e240 2024-04-26T17:59:07.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.689+0000 7fc79f7fe640 1 -- 172.21.15.12:0/4065385582 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c032810 con 0x7fc7a006e240 2024-04-26T17:59:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 -- 172.21.15.12:0/4065385582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a006e240 msgr2=0x7fc7a00c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/4065385582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a006e240 0x7fc7a00c96d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc78c0097a0 tx=0x7fc78c02a270 comp rx=0 tx=0).stop 2024-04-26T17:59:07.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 -- 172.21.15.12:0/4065385582 shutdown_connections 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/4065385582 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a006e240 0x7fc7a00c96d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 -- 172.21.15.12:0/4065385582 >> 172.21.15.12:0/4065385582 conn(0x7fc7a0068270 msgr2=0x7fc7a0068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 -- 172.21.15.12:0/4065385582 shutdown_connections 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.690+0000 7fc7a70ea640 1 -- 172.21.15.12:0/4065385582 wait complete. 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.691+0000 7fc7a70ea640 1 Processor -- start 2024-04-26T17:59:07.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.691+0000 7fc7a70ea640 1 -- start start 2024-04-26T17:59:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc7a006e240 0x7fc7a01e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a015ce60 0x7fc7a015b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a00735a0 con 0x7fc7a0153b10 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0073910 con 0x7fc7a015ce60 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a70ea640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc7a0153ef0 con 0x7fc7a006e240 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38476/0 (socket says 172.21.15.12:38476) 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 -- 172.21.15.12:0/574101213 learned_addr learned my addr 172.21.15.12:0/574101213 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a5687640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a015ce60 0x7fc7a015b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc7a4e86640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc7a006e240 0x7fc7a01e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 -- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc7a006e240 msgr2=0x7fc7a01e6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc7a006e240 0x7fc7a01e6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 -- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a015ce60 msgr2=0x7fc7a015b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a015ce60 0x7fc7a015b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 -- 172.21.15.12:0/574101213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a00cc1e0 con 0x7fc7a0153b10 2024-04-26T17:59:07.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.692+0000 7fc79ffff640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.693+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c037040 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.693+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc78c042070 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.693+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a01f57b0 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.693+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78c030a70 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.693+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a01f5d70 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.694+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a00c6e30 con 0x7fc7a0153b10 2024-04-26T17:59:07.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.694+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc78c030c10 con 0x7fc7a0153b10 2024-04-26T17:59:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.695+0000 7fc79d7fa640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.695+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fc78c0aca40 con 0x7fc7a0153b10 2024-04-26T17:59:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.695+0000 7fc7a4e86640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:07.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.696+0000 7fc7a4e86640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 0x7fc78406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc794004ea0 tx=0x7fc794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:07.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.700+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7a00c6e30 con 0x7fc7a0153b10 2024-04-26T17:59:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.923+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7a0076d20 con 0x7fc7a0153b10 2024-04-26T17:59:07.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.923+0000 7fc79d7fa640 1 -- 172.21.15.12:0/574101213 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fc78c0ace20 con 0x7fc7a0153b10 2024-04-26T17:59:07.924 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:59:07.924 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:59:07.924 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 msgr2=0x7fc78406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 0x7fc78406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc794004ea0 tx=0x7fc794009040 comp rx=0 tx=0).stop 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 msgr2=0x7fc7a015b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc78c000c00 tx=0x7fc78c0046c0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 shutdown_connections 2024-04-26T17:59:07.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7a015ce60 0x7fc7a015b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc7a0153b10 0x7fc7a015b080 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc78406c8f0 0x7fc78406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 --2- 172.21.15.12:0/574101213 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc7a006e240 0x7fc7a01e6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 >> 172.21.15.12:0/574101213 conn(0x7fc7a0068270 msgr2=0x7fc7a0152270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 shutdown_connections 2024-04-26T17:59:07.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:07.925+0000 7fc7a70ea640 1 -- 172.21.15.12:0/574101213 wait complete. 2024-04-26T17:59:07.936 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T17:59:07.937 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T17:59:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.047+0000 7fa80c42a640 1 Processor -- start 2024-04-26T17:59:08.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.047+0000 7fa80c42a640 1 -- start start 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80c42a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c64b0 0x7fa8040c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80c42a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8040c7d30 0x7fa8040cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80c42a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa804156200 con 0x7fa804155e20 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80c42a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa8040cd550 con 0x7fa8040c7d30 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80c42a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa80415c330 con 0x7fa8040c64b0 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8040c7d30 0x7fa8040cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8040c7d30 0x7fa8040cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38478/0 (socket says 172.21.15.12:38478) 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 -- 172.21.15.12:0/574753302 learned_addr learned my addr 172.21.15.12:0/574753302 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa8099c5640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c64b0 0x7fa8040c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 -- 172.21.15.12:0/574753302 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c64b0 msgr2=0x7fa8040c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c64b0 0x7fa8040c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 -- 172.21.15.12:0/574753302 >> v1:172.21.15.100:6789/0 conn(0x7fa804155e20 legacy=0x7fa80415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.048+0000 7fa80a9c7640 1 -- 172.21.15.12:0/574753302 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80415c610 con 0x7fa8040c7d30 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.049+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8040c7d30 0x7fa8040cc1c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009e50 tx=0x7fa7f402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc927d68b8886e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.049+0000 7fa8091c4640 1 -- 172.21.15.12:0/574753302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4036070 con 0x7fa8040c7d30 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.049+0000 7fa8091c4640 1 -- 172.21.15.12:0/574753302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4031600 con 0x7fa8040c7d30 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.049+0000 7fa8091c4640 1 -- 172.21.15.12:0/574753302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40319d0 con 0x7fa8040c7d30 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 -- 172.21.15.12:0/574753302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8040c7d30 msgr2=0x7fa8040cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8040c7d30 0x7fa8040cc1c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009e50 tx=0x7fa7f402a7a0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 -- 172.21.15.12:0/574753302 shutdown_connections 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8040c7d30 0x7fa8040cc1c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 --2- 172.21.15.12:0/574753302 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c64b0 0x7fa8040c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 -- 172.21.15.12:0/574753302 >> 172.21.15.12:0/574753302 conn(0x7fa804072930 msgr2=0x7fa804072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 -- 172.21.15.12:0/574753302 shutdown_connections 2024-04-26T17:59:08.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.050+0000 7fa80c42a640 1 -- 172.21.15.12:0/574753302 wait complete. 2024-04-26T17:59:08.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.051+0000 7fa80c42a640 1 Processor -- start 2024-04-26T17:59:08.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.051+0000 7fa80c42a640 1 -- start start 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8040c64b0 0x7fa804158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c7d30 0x7fa80414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8040c72d0 con 0x7fa804155e20 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8040c6ff0 con 0x7fa8040c64b0 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80c42a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8040c68d0 con 0x7fa8040c7d30 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38484/0 (socket says 172.21.15.12:38484) 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 -- 172.21.15.12:0/3095213003 learned_addr learned my addr 172.21.15.12:0/3095213003 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa8099c5640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c7d30 0x7fa80414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8040c64b0 0x7fa804158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 -- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c7d30 msgr2=0x7fa80414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c7d30 0x7fa80414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 -- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8040c64b0 msgr2=0x7fa804158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8040c64b0 0x7fa804158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.052+0000 7fa80a9c7640 1 -- 172.21.15.12:0/3095213003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8040cdfe0 con 0x7fa804155e20 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034040 tx=0x7fa7f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa802ffd640 1 -- 172.21.15.12:0/3095213003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4036050 con 0x7fa804155e20 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa802ffd640 1 -- 172.21.15.12:0/3095213003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4042070 con 0x7fa804155e20 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa804151ed0 con 0x7fa804155e20 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa802ffd640 1 -- 172.21.15.12:0/3095213003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4009510 con 0x7fa804155e20 2024-04-26T17:59:08.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.053+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80414e920 con 0x7fa804155e20 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.054+0000 7fa802ffd640 1 -- 172.21.15.12:0/3095213003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7f4007b70 con 0x7fa804155e20 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.055+0000 7fa802ffd640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 0x7fa7f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.055+0000 7fa802ffd640 1 -- 172.21.15.12:0/3095213003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa7f40acc90 con 0x7fa804155e20 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.055+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 0x7fa7f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.056+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 0x7fa7f006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000f60 tx=0x7fa7fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.056+0000 7fa80f224740 1 Processor -- start 2024-04-26T17:59:08.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.056+0000 7fa80f224740 1 -- start start 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be91e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be8df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5576be842d80 con 0x5576be8e0b40 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576be7dec20 con 0x5576be91eae0 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5576be83ed40 con 0x5576be8df5e0 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38494/0 (socket says 172.21.15.12:38494) 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 -- 172.21.15.12:0/1267121451 learned_addr learned my addr 172.21.15.12:0/1267121451 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be91e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa8099c5640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be8df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 -- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 msgr2=0x5576be91e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be91e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 -- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 msgr2=0x5576be8df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be8df9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 -- 172.21.15.12:0/1267121451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576be620d80 con 0x5576be8e0b40 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be91e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa8099c5640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be8df9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.057+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4082d30 tx=0x7fa7f402ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7ecd6f55cae25e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa7ebfff640 1 -- 172.21.15.12:0/1267121451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f407a6a0 con 0x5576be8e0b40 2024-04-26T17:59:08.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa7ebfff640 1 -- 172.21.15.12:0/1267121451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4037040 con 0x5576be8e0b40 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa7ebfff640 1 -- 172.21.15.12:0/1267121451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f407e9a0 con 0x5576be8e0b40 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 -- 172.21.15.12:0/1267121451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 msgr2=0x5576be8dff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4082d30 tx=0x7fa7f402ad50 comp rx=0 tx=0).stop 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 -- 172.21.15.12:0/1267121451 shutdown_connections 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be8dff00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be8df9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 --2- 172.21.15.12:0/1267121451 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be91e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 -- 172.21.15.12:0/1267121451 >> 172.21.15.12:0/1267121451 conn(0x5576be8a6740 msgr2=0x5576be923580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 -- 172.21.15.12:0/1267121451 shutdown_connections 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.058+0000 7fa80f224740 1 -- 172.21.15.12:0/1267121451 wait complete. 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.059+0000 7fa80f224740 1 -- start start 2024-04-26T17:59:08.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.059+0000 7fa80f224740 1 Processor -- start 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be917420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be917960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5576be842d80 con 0x5576be8df5e0 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5576be7dc840 con 0x5576be91eae0 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5576be8ddc20 con 0x5576be8e0b40 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80f224740 10 client.0 _ll_register_callbacks cb 0x5576be7e05b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:08.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38504/0 (socket says 172.21.15.12:38504) 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 -- 172.21.15.12:0/4188693546 learned_addr learned my addr 172.21.15.12:0/4188693546 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be917960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa8099c5640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be917420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 -- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 msgr2=0x5576be917420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be917420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 -- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 msgr2=0x5576be917960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be917960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a1c6640 1 -- 172.21.15.12:0/4188693546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576be681510 con 0x5576be8df5e0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be917960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.060+0000 7fa8099c5640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be917420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00fff0 tx=0x7fa7fc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c881dc92696c1802 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:08.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0135c0 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa7fc013760 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7f4037040 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa7fc02d050 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 10 client.4818 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5576be514670 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7f4037040 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa7fc030020 con 0x5576be8df5e0 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 10 client.4818 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 20 client.4818 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be907250 0x5576be9333d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 4 client.4818 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576be850990 con 0x5576be907250 2024-04-26T17:59:08.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.061+0000 7fa8099c5640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be907250 0x5576be9333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.062+0000 7fa8099c5640 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be907250 0x5576be9333d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4712ec80ba7f6e25 server_cookie=4411ad5db8d441f2 in_seq=0 out_seq=0 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.062+0000 7fa7e97fa640 10 client.4818 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.062+0000 7fa7e97fa640 1 -- 172.21.15.12:0/4188693546 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5576be850990 con 0x5576be907250 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.062+0000 7fa7e97fa640 10 client.4818 handle_command_reply: tid=0 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 client.4818 shutdown 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 msgr2=0x5576be91c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00fff0 tx=0x7fa7fc000ed0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 shutdown_connections 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be907250 0x5576be9333d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be917960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be917420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 --2- 172.21.15.12:0/4188693546 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be91c3b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa7e97fa640 0 client.4818 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:08.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 >> 172.21.15.12:0/4188693546 conn(0x5576be8a6740 msgr2=0x5576be8df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 shutdown_connections 2024-04-26T17:59:08.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 1 -- 172.21.15.12:0/4188693546 wait complete. 2024-04-26T17:59:08.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.063+0000 7fa80f224740 20 client.4818 trim_cache size 0 max 16384 2024-04-26T17:59:08.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.080+0000 7fa80f224740 1 Processor -- start 2024-04-26T17:59:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.080+0000 7fa80f224740 1 -- start start 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be92d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be92d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8042008d0 con 0x5576be8df5e0 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8041ff7b0 con 0x5576be91eae0 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8040d0e30 con 0x5576be8e0b40 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38508/0 (socket says 172.21.15.12:38508) 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 -- 172.21.15.12:0/717951828 learned_addr learned my addr 172.21.15.12:0/717951828 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 -- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 msgr2=0x5576be92d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be92d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 -- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 msgr2=0x5576be92d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.083 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be92d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.081+0000 7fa80a1c6640 1 -- 172.21.15.12:0/717951828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576be8db750 con 0x5576be8df5e0 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc014e10 tx=0x7fa7fc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c17e69239eee5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa7eb7fe640 1 -- 172.21.15.12:0/717951828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc0135c0 con 0x5576be8df5e0 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa7eb7fe640 1 -- 172.21.15.12:0/717951828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc025070 con 0x5576be8df5e0 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa7eb7fe640 1 -- 172.21.15.12:0/717951828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7fc00fbc0 con 0x5576be8df5e0 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 -- 172.21.15.12:0/717951828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 msgr2=0x5576be8dfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc014e10 tx=0x7fa7fc01f000 comp rx=0 tx=0).stop 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 -- 172.21.15.12:0/717951828 shutdown_connections 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be92d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8e0b40 0x5576be92d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 --2- 172.21.15.12:0/717951828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8df5e0 0x5576be8dfbb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 -- 172.21.15.12:0/717951828 >> 172.21.15.12:0/717951828 conn(0x5576be8a6740 msgr2=0x5576be8dd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 -- 172.21.15.12:0/717951828 shutdown_connections 2024-04-26T17:59:08.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.082+0000 7fa80f224740 1 -- 172.21.15.12:0/717951828 wait complete. 2024-04-26T17:59:08.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.083+0000 7fa80f224740 1 -- start start 2024-04-26T17:59:08.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.083+0000 7fa80f224740 1 Processor -- start 2024-04-26T17:59:08.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be9301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be999ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8041fe3d0 con 0x5576be8e0b40 2024-04-26T17:59:08.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8041ff100 con 0x5576be91eae0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8041fea50 con 0x5576be8df5e0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 10 client.0 _ll_register_callbacks cb 0x7fa7fc017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38522/0 (socket says 172.21.15.12:38522) 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 -- 172.21.15.12:0/2109630490 learned_addr learned my addr 172.21.15.12:0/2109630490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be999ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be9301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 -- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 msgr2=0x5576be9301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be9301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 -- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 msgr2=0x5576be999ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be999ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 -- 172.21.15.12:0/2109630490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576be8dcda0 con 0x5576be8e0b40 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80a9c7640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be999ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be9301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:08.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa8099c5640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5576be921070 tx=0x7fa7f8003610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c713a44418bfa459 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa7e97fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7f801db50 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa7f801dcf0 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.084+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa7fc025070 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa7f802a050 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 10 client.4824 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5576be99ce50 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7fc025070 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa7f802d020 con 0x5576be8e0b40 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 10 client.4824 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 20 client.4824 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be9339a0 0x5576be99a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:08.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 4 client.4824 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T17:59:08.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x5576be9236f0 con 0x5576be9339a0 2024-04-26T17:59:08.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be9339a0 0x5576be99a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:08.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa80a1c6640 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be9339a0 0x5576be99a220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=227f3ced94f5cbd6 server_cookie=62b8f2c12db2eb3 in_seq=0 out_seq=0 2024-04-26T17:59:08.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.085+0000 7fa7e97fa640 10 client.4824 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa7e97fa640 1 -- 172.21.15.12:0/2109630490 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5576be9236f0 con 0x5576be9339a0 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa7e97fa640 10 client.4824 handle_command_reply: tid=0 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 client.4824 shutdown 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 msgr2=0x5576be99d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5576be921070 tx=0x7fa7f8003610 comp rx=0 tx=0).stop 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 shutdown_connections 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5576be9339a0 0x5576be99a220 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5576be91eae0 0x5576be999ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5576be8e0b40 0x5576be99d650 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 --2- 172.21.15.12:0/2109630490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5576be8df5e0 0x5576be9301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa7e97fa640 0 client.4824 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 >> 172.21.15.12:0/2109630490 conn(0x5576be8a6740 msgr2=0x5576be8dd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 shutdown_connections 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 1 -- 172.21.15.12:0/2109630490 wait complete. 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.090+0000 7fa80f224740 20 client.4824 trim_cache size 0 max 16384 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 2, 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T17:59:08.092 INFO:teuthology.orchestra.run.smithi012.stdout: "316114c6": { 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 2, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 90.0, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:08.093 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:08.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:08.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:08.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:08.094 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:08.094 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 msgr2=0x7fa7f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 0x7fa7f006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc000f60 tx=0x7fa7fc009040 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 msgr2=0x7fa80414c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4034040 tx=0x7fa7f4004a40 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 shutdown_connections 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa804155e20 0x7fa80414c210 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa7f006c8f0 0x7fa7f006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8040c7d30 0x7fa80414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 --2- 172.21.15.12:0/3095213003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8040c64b0 0x7fa804158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 >> 172.21.15.12:0/3095213003 conn(0x7fa804072930 msgr2=0x7fa804151190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 shutdown_connections 2024-04-26T17:59:08.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:08.091+0000 7fa80c42a640 1 -- 172.21.15.12:0/3095213003 wait complete. 2024-04-26T17:59:08.102 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '316114c6', quiesce took 0.5 seconds. Will release after: 30.0 2024-04-26T17:59:13.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:13.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:38.103 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:38.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.208+0000 7f609c378640 1 Processor -- start 2024-04-26T17:59:38.209 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.208+0000 7f609c378640 1 -- start start 2024-04-26T17:59:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 0x7f609415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6094156180 0x7f60940d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60940cd840 0x7f60940d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.210 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f609415cbc0 con 0x7f60940cd840 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f60940cc730 con 0x7f6094155da0 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.209+0000 7f609c378640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f609415f2a0 con 0x7f6094156180 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60940cd840 0x7f60940d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60940cd840 0x7f60940d1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59232/0 (socket says 172.21.15.12:59232) 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 -- 172.21.15.12:0/2629536322 learned_addr learned my addr 172.21.15.12:0/2629536322 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a114640 1 --2- 172.21.15.12:0/2629536322 >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 0x7f609415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f6099913640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6094156180 0x7f60940d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 -- 172.21.15.12:0/2629536322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6094156180 msgr2=0x7f60940d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6094156180 0x7f60940d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 -- 172.21.15.12:0/2629536322 >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 msgr2=0x7f609415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 --2- 172.21.15.12:0/2629536322 >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 0x7f609415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a915640 1 -- 172.21.15.12:0/2629536322 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609415f580 con 0x7f60940cd840 2024-04-26T17:59:38.211 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.210+0000 7f609a114640 1 --2- 172.21.15.12:0/2629536322 >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 0x7f609415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f609a915640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60940cd840 0x7f60940d1800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f60940d2150 tx=0x7f608c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cfc5ed965b8c67 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f6099112640 1 -- 172.21.15.12:0/2629536322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c036070 con 0x7f60940cd840 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f6099112640 1 -- 172.21.15.12:0/2629536322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f608c031600 con 0x7f60940cd840 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f6099112640 1 -- 172.21.15.12:0/2629536322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608c0319d0 con 0x7f60940cd840 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f609c378640 1 -- 172.21.15.12:0/2629536322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60940cd840 msgr2=0x7f60940d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.211+0000 7f609c378640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60940cd840 0x7f60940d1800 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f60940d2150 tx=0x7f608c02a610 comp rx=0 tx=0).stop 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 -- 172.21.15.12:0/2629536322 shutdown_connections 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60940cd840 0x7f60940d1800 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 --2- 172.21.15.12:0/2629536322 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6094156180 0x7f60940d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 --2- 172.21.15.12:0/2629536322 >> v2:172.21.15.100:3300/0 conn(0x7f6094155da0 0x7f609415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 -- 172.21.15.12:0/2629536322 >> 172.21.15.12:0/2629536322 conn(0x7f6094068090 msgr2=0x7f60940684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 -- 172.21.15.12:0/2629536322 shutdown_connections 2024-04-26T17:59:38.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.212+0000 7f609c378640 1 -- 172.21.15.12:0/2629536322 wait complete. 2024-04-26T17:59:38.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.213+0000 7f609c378640 1 Processor -- start 2024-04-26T17:59:38.214 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.213+0000 7f609c378640 1 -- start start 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60940cd840 0x7f60941f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f609415e590 0x7f609414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f60940cc160 con 0x7f6094155da0 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f609415fb40 con 0x7f609415e590 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f60940cc2e0 con 0x7f60940cd840 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59242/0 (socket says 172.21.15.12:59242) 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 -- 172.21.15.12:0/3165976749 learned_addr learned my addr 172.21.15.12:0/3165976749 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609a114640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60940cd840 0x7f60941f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609a915640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f609415e590 0x7f609414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 -- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60940cd840 msgr2=0x7f60941f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60940cd840 0x7f60941f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 -- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f609415e590 msgr2=0x7f609414e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f609415e590 0x7f609414e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 -- 172.21.15.12:0/3165976749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609414e340 con 0x7f6094155da0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f6099913640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f608400d830 tx=0x7f608400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608400b6c0 con 0x7f6094155da0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6084019070 con 0x7f6094155da0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.214+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60941f5030 con 0x7f6094155da0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.215+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f608400ba80 con 0x7f6094155da0 2024-04-26T17:59:38.217 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.215+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609415edd0 con 0x7f6094155da0 2024-04-26T17:59:38.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.216+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60940c8e40 con 0x7f6094155da0 2024-04-26T17:59:38.218 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.216+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f608401e460 con 0x7f6094155da0 2024-04-26T17:59:38.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.217+0000 7f608affd640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 0x7f607806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.217+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f608408c4e0 con 0x7f6094155da0 2024-04-26T17:59:38.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.217+0000 7f609a114640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 0x7f607806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.219 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.218+0000 7f609a114640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 0x7f607806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6090006fd0 tx=0x7f6090008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.221 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.222+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6084059e30 con 0x7f6094155da0 2024-04-26T17:59:38.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.444+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6094076d20 con 0x7f6094155da0 2024-04-26T17:59:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.445+0000 7f608affd640 1 -- 172.21.15.12:0/3165976749 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f608405e130 con 0x7f6094155da0 2024-04-26T17:59:38.445 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:59:38.445 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:59:38.445 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.446+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 msgr2=0x7f607806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.446+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 0x7f607806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6090006fd0 tx=0x7f6090008040 comp rx=0 tx=0).stop 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.446+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 msgr2=0x7f609415a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.446+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f608400d830 tx=0x7f608400dcf0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 shutdown_connections 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f609415e590 0x7f609414e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6094155da0 0x7f609415a8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f607806c8f0 0x7f607806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 --2- 172.21.15.12:0/3165976749 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f60940cd840 0x7f60941f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 >> 172.21.15.12:0/3165976749 conn(0x7f6094068090 msgr2=0x7f6094155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 shutdown_connections 2024-04-26T17:59:38.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.447+0000 7f609c378640 1 -- 172.21.15.12:0/3165976749 wait complete. 2024-04-26T17:59:38.458 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 316114c6 --release --await' 2024-04-26T17:59:38.458 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 316114c6 --release --await 2024-04-26T17:59:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.566+0000 7f34169f9640 1 Processor -- start 2024-04-26T17:59:38.566 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.566+0000 7f34169f9640 1 -- start start 2024-04-26T17:59:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f34169f9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f34169f9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f34100cc0e0 0x7f34100cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f34169f9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34100cca70 con 0x7f34101527f0 2024-04-26T17:59:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f34169f9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f34100c6780 con 0x7f34100cc0e0 2024-04-26T17:59:38.568 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f34169f9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f341015cbc0 con 0x7f34100d1320 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f340ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34101527f0 0x7f341015f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38480/0 (socket says 172.21.15.12:38480) 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f340ffff640 1 -- 172.21.15.12:0/421616283 learned_addr learned my addr 172.21.15.12:0/421616283 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f340f7fe640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f3414f96640 1 --2- 172.21.15.12:0/421616283 >> v2:172.21.15.100:3300/0 conn(0x7f34100cc0e0 0x7f34100cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f340effd640 1 -- 172.21.15.12:0/421616283 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873387458 0 0) 0x7f34100cca70 con 0x7f34101527f0 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.567+0000 7f340effd640 1 -- 172.21.15.12:0/421616283 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33f8003520 con 0x7f34101527f0 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.568+0000 7f3414f96640 1 -- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 msgr2=0x7f34100d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.569 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.568+0000 7f3414f96640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.568+0000 7f3414f96640 1 -- 172.21.15.12:0/421616283 >> v1:172.21.15.12:6789/0 conn(0x7f34101527f0 legacy=0x7f341015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.570 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.568+0000 7f3414f96640 1 -- 172.21.15.12:0/421616283 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341015c040 con 0x7f34100cc0e0 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.568+0000 7f3414f96640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34100cc530 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b9ed197a13ef46 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f340effd640 1 -- 172.21.15.12:0/421616283 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408007740 con 0x7f34100cc0e0 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f340effd640 1 -- 172.21.15.12:0/421616283 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34080078e0 con 0x7f34100cc0e0 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f340effd640 1 -- 172.21.15.12:0/421616283 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408007c90 con 0x7f34100cc0e0 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 -- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 msgr2=0x7f34100cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34100cc530 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340802a660 comp rx=0 tx=0).stop 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 -- 172.21.15.12:0/421616283 shutdown_connections 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34100cc530 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 --2- 172.21.15.12:0/421616283 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 -- 172.21.15.12:0/421616283 >> 172.21.15.12:0/421616283 conn(0x7f3410076100 msgr2=0x7f3410073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 -- 172.21.15.12:0/421616283 shutdown_connections 2024-04-26T17:59:38.584 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.569+0000 7f34169f9640 1 -- 172.21.15.12:0/421616283 wait complete. 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.570+0000 7f34169f9640 1 Processor -- start 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.570+0000 7f34169f9640 1 -- start start 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34101f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f341015c8e0 con 0x7f34101527f0 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f341015c600 con 0x7f34100cc0e0 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f34169f9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f34100cdb00 con 0x7f34100d1320 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59252/0 (socket says 172.21.15.12:59252) 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f3414f96640 1 -- 172.21.15.12:0/101423016 learned_addr learned my addr 172.21.15.12:0/101423016 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f340f7fe640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.571+0000 7f340ffff640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34101f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 -- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 msgr2=0x7f34100c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.585 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 -- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 msgr2=0x7f34101f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34101f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 -- 172.21.15.12:0/101423016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3410156a50 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f3414f96640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f340802ac50 tx=0x7f3408004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f340cff9640 1 -- 172.21.15.12:0/101423016 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408040070 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f340cff9640 1 -- 172.21.15.12:0/101423016 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3408031c60 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f340cff9640 1 -- 172.21.15.12:0/101423016 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408009450 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34100c6910 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.572+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34100c6eb0 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.573+0000 7f340cff9640 1 -- 172.21.15.12:0/101423016 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3408039040 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.574+0000 7f340cff9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 0x7f33fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.574+0000 7f340cff9640 1 -- 172.21.15.12:0/101423016 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f34080ad250 con 0x7f34101527f0 2024-04-26T17:59:38.586 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.574+0000 7f340ffff640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 0x7f33fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f340ffff640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 0x7f33fc06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3404005880 tx=0x7f3404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 Processor -- start 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 -- start start 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010aa470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x56430106b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564300fd0040 con 0x56430106ca10 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564300f6bb60 con 0x5643010aa9b0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.575+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x564300fcc000 con 0x56430106b4b0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59254/0 (socket says 172.21.15.12:59254) 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f340f7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x56430106b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 -- 172.21.15.12:0/277824464 learned_addr learned my addr 172.21.15.12:0/277824464 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f340ffff640 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.587 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 -- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 msgr2=0x5643010aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 -- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 msgr2=0x56430106b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x56430106b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 -- 172.21.15.12:0/277824464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564300f609c0 con 0x56430106ca10 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f340f7fe640 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x56430106b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f3414f96640 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34080ab2f0 tx=0x7f340807a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c821e4c1b1de8235 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f33f5ffb640 1 -- 172.21.15.12:0/277824464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080078c0 con 0x56430106ca10 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f33f5ffb640 1 -- 172.21.15.12:0/277824464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340807aba0 con 0x56430106ca10 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.576+0000 7f33f5ffb640 1 -- 172.21.15.12:0/277824464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340807eea0 con 0x56430106ca10 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- 172.21.15.12:0/277824464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 msgr2=0x56430106bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34080ab2f0 tx=0x7f340807a9f0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- 172.21.15.12:0/277824464 shutdown_connections 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x56430106bdd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.588 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x56430106b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 --2- 172.21.15.12:0/277824464 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- 172.21.15.12:0/277824464 >> 172.21.15.12:0/277824464 conn(0x564301032930 msgr2=0x5643010af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- 172.21.15.12:0/277824464 shutdown_connections 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- 172.21.15.12:0/277824464 wait complete. 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.577+0000 7f34197ea740 1 -- start start 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 Processor -- start 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106ca10 0x5643010a6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x5643010bef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564300fd0040 con 0x56430106b4b0 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x564300f694f0 con 0x5643010aa9b0 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x564301069af0 con 0x56430106ca10 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f34197ea740 10 client.0 _ll_register_callbacks cb 0x564300fc6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.578+0000 7f340ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.589 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59270/0 (socket says 172.21.15.12:59270) 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 -- 172.21.15.12:0/216360006 learned_addr learned my addr 172.21.15.12:0/216360006 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f3414f96640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x5643010bef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340f7fe640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106ca10 0x5643010a6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 -- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106ca10 msgr2=0x5643010a6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106ca10 0x5643010a6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 -- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 msgr2=0x5643010bef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x5643010bef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 -- 172.21.15.12:0/216360006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564300ce1920 con 0x56430106b4b0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f3414f96640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x5643010bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f340ffff640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3404015710 tx=0x7f3404000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4064ee47c31cbfd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f33eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040137c0 con 0x56430106b4b0 2024-04-26T17:59:38.590 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3404010040 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340807aba0 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f340402e050 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f34197ea740 10 client.4842 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.579+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564300dadd30 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340807aba0 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3404031020 con 0x56430106b4b0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 10 client.4842 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 20 client.4842 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564301092e00 0x564301093220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 4 client.4842 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564300fa3a00 con 0x564301092e00 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f340f7fe640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564301092e00 0x564301093220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.591 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f340f7fe640 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564301092e00 0x564301093220 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e74af3ac3669b6b server_cookie=8c9748b10deff1eb in_seq=0 out_seq=0 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.580+0000 7f33eeffd640 10 client.4842 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f33eeffd640 1 -- 172.21.15.12:0/216360006 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564300fa3a00 con 0x564301092e00 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f33eeffd640 10 client.4842 handle_command_reply: tid=0 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 client.4842 shutdown 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 msgr2=0x5643010be5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3404015710 tx=0x7f3404000bc0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 shutdown_connections 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564301092e00 0x564301093220 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5643010aa9b0 0x5643010bef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106ca10 0x5643010a6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f33eeffd640 0 client.4842 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:38.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 --2- 172.21.15.12:0/216360006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106b4b0 0x5643010be5b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 >> 172.21.15.12:0/216360006 conn(0x564301032930 msgr2=0x564301064e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 shutdown_connections 2024-04-26T17:59:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.581+0000 7f34197ea740 1 -- 172.21.15.12:0/216360006 wait complete. 2024-04-26T17:59:38.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.582+0000 7f34197ea740 20 client.4842 trim_cache size 0 max 16384 2024-04-26T17:59:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 Processor -- start 2024-04-26T17:59:38.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 -- start start 2024-04-26T17:59:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010931e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 0x564301093720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.599+0000 7f34197ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34102004d0 con 0x564301092e00 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34101ff3b0 con 0x56430106ca10 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f34101f5ad0 con 0x56430106b4b0 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59276/0 (socket says 172.21.15.12:59276) 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 -- 172.21.15.12:0/41369504 learned_addr learned my addr 172.21.15.12:0/41369504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f340f7fe640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 0x564301093720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f340ffff640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010931e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 -- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 msgr2=0x5643010931e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010931e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 -- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 msgr2=0x564301093720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 0x564301093720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 -- 172.21.15.12:0/41369504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564301068c70 con 0x564301092e00 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f340f7fe640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 0x564301093720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f340ffff640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f3414f96640 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f340807aae0 tx=0x7f340807c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c4e5c74c803c9f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f33f57fa640 1 -- 172.21.15.12:0/41369504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408099070 con 0x564301092e00 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f33f57fa640 1 -- 172.21.15.12:0/41369504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340807aba0 con 0x564301092e00 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.600+0000 7f33f57fa640 1 -- 172.21.15.12:0/41369504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408083760 con 0x564301092e00 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- 172.21.15.12:0/41369504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 msgr2=0x5643010a4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f340807aae0 tx=0x7f340807c000 comp rx=0 tx=0).stop 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- 172.21.15.12:0/41369504 shutdown_connections 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x564301092e00 0x5643010a4f00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106ca10 0x564301093720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 --2- 172.21.15.12:0/41369504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56430106b4b0 0x5643010931e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- 172.21.15.12:0/41369504 >> 172.21.15.12:0/41369504 conn(0x564301032930 msgr2=0x5643010a2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- 172.21.15.12:0/41369504 shutdown_connections 2024-04-26T17:59:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- 172.21.15.12:0/41369504 wait complete. 2024-04-26T17:59:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 -- start start 2024-04-26T17:59:38.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.601+0000 7f34197ea740 1 Processor -- start 2024-04-26T17:59:38.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106b4b0 0x5643010bba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x564301092e00 0x56430106b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f34101fdf70 con 0x56430106ca10 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f34101fece0 con 0x56430106b4b0 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f34101fe610 con 0x564301092e00 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f34197ea740 10 client.0 _ll_register_callbacks cb 0x7f34040011b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f340f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f340f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59290/0 (socket says 172.21.15.12:59290) 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f340f7fe640 1 -- 172.21.15.12:0/1933702426 learned_addr learned my addr 172.21.15.12:0/1933702426 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f340ffff640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106b4b0 0x5643010bba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.602+0000 7f3414f96640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x564301092e00 0x56430106b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 -- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x564301092e00 msgr2=0x56430106b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x564301092e00 0x56430106b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.608 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 -- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106b4b0 msgr2=0x5643010bba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106b4b0 0x5643010bba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 -- 172.21.15.12:0/1933702426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564301067280 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f340f7fe640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f34000093c0 tx=0x7f340001ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250120e546295a73 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3400016db0 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f340807aba0 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f3400004030 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f340002e050 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 10 client.4848 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564301094550 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f340807aba0 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3400031020 con 0x56430106ca10 2024-04-26T17:59:38.609 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 10 client.4848 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 10 client.4848 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 20 client.4848 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.603+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5643010aa9b0 0x56430106bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f34197ea740 4 client.4848 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "316114c6", "release": true, "await": true}] 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "316114c6", "release": true, "await": true}) -- 0x564300fddc50 con 0x5643010aa9b0 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f340ffff640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5643010aa9b0 0x56430106bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f340ffff640 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5643010aa9b0 0x56430106bdd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd9f842a10dd4ae server_cookie=24589bab59462902 in_seq=0 out_seq=0 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f33eeffd640 10 client.4848 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f33eeffd640 1 -- 172.21.15.12:0/1933702426 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x564300fddc50 con 0x5643010aa9b0 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f33eeffd640 10 client.4848 handle_command_reply: tid=0 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.604+0000 7f34197ea740 1 client.4848 shutdown 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 msgr2=0x5643010bbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f34000093c0 tx=0x7f340001ff00 comp rx=0 tx=0).stop 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 shutdown_connections 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x564301092e00 0x56430106b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56430106ca10 0x5643010bbf40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5643010aa9b0 0x56430106bdd0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 --2- 172.21.15.12:0/1933702426 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56430106b4b0 0x5643010bba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f33eeffd640 0 client.4848 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 >> 172.21.15.12:0/1933702426 conn(0x564301032930 msgr2=0x5643010ab800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 shutdown_connections 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 1 -- 172.21.15.12:0/1933702426 wait complete. 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34197ea740 20 client.4848 trim_cache size 0 max 16384 2024-04-26T17:59:38.611 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 4, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "316114c6": { 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 4, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 90.0, 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T17:59:38.612 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:38.613 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 msgr2=0x7f33fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 0x7f33fc06edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3404005880 tx=0x7f3404009040 comp rx=0 tx=0).stop 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 msgr2=0x7f34100ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f340802ac50 tx=0x7f3408004a40 comp rx=0 tx=0).stop 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 shutdown_connections 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34101527f0 0x7f34100ca0b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f33fc06c8f0 0x7f33fc06edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f34100d1320 0x7f34100c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 --2- 172.21.15.12:0/101423016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34100cc0e0 0x7f34101f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.605+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 >> 172.21.15.12:0/101423016 conn(0x7f3410076100 msgr2=0x7f341015b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.606+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 shutdown_connections 2024-04-26T17:59:38.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.606+0000 7f34169f9640 1 -- 172.21.15.12:0/101423016 wait complete. 2024-04-26T17:59:38.616 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '316114c6', seconds elapsed: 31.0 2024-04-26T17:59:38.616 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-04-26T17:59:38.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T17:59:38.718 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.718+0000 7f7e10319640 1 Processor -- start 2024-04-26T17:59:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.718+0000 7f7e10319640 1 -- start start 2024-04-26T17:59:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e10319640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 0x7f7e0806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.719 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e10319640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e10319640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e08159d70 con 0x7f7e08153c50 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e10319640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7e080c43a0 con 0x7f7e080cb950 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e10319640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0815a8d0 con 0x7f7e080caab0 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e0e8b6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.719+0000 7f7e0d8b4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 0x7f7e0806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0e8b6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:44618/0 (socket says 172.21.15.12:44618) 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0e0b5640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7e08153c50 0x7f7e080cf950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:39394/0 (socket says 172.21.15.12:39394) 2024-04-26T17:59:38.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0e8b6640 1 -- 172.21.15.12:0/3637030138 learned_addr learned my addr 172.21.15.12:0/3637030138 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.721 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0d8b4640 1 -- 172.21.15.12:0/3637030138 >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 msgr2=0x7f7e080702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0d8b4640 1 --2- 172.21.15.12:0/3637030138 >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0d8b4640 1 -- 172.21.15.12:0/3637030138 >> v1:172.21.15.100:6789/0 conn(0x7f7e08153c50 legacy=0x7f7e080cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0d8b4640 1 -- 172.21.15.12:0/3637030138 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e08154030 con 0x7f7e080caab0 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0d0b3640 1 -- 172.21.15.12:0/3637030138 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719556354 0 0) 0x7f7e08159d70 con 0x7f7e08153c50 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.720+0000 7f7e0e8b6640 1 --2- 172.21.15.12:0/3637030138 >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e0d8b4640 1 --2- 172.21.15.12:0/3637030138 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 0x7f7e0806fdb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e5b84fefb8445af server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e0d0b3640 1 -- 172.21.15.12:0/3637030138 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc037070 con 0x7f7e080caab0 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e0d0b3640 1 -- 172.21.15.12:0/3637030138 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dfc032440 con 0x7f7e080caab0 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e0d0b3640 1 -- 172.21.15.12:0/3637030138 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc032810 con 0x7f7e080caab0 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 -- 172.21.15.12:0/3637030138 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 msgr2=0x7f7e0806fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 --2- 172.21.15.12:0/3637030138 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 0x7f7e0806fdb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02a210 comp rx=0 tx=0).stop 2024-04-26T17:59:38.722 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 -- 172.21.15.12:0/3637030138 shutdown_connections 2024-04-26T17:59:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 --2- 172.21.15.12:0/3637030138 >> v2:172.21.15.100:3300/0 conn(0x7f7e080cb950 0x7f7e080702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 --2- 172.21.15.12:0/3637030138 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080caab0 0x7f7e0806fdb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 -- 172.21.15.12:0/3637030138 >> 172.21.15.12:0/3637030138 conn(0x7f7e08071bf0 msgr2=0x7f7e08071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 -- 172.21.15.12:0/3637030138 shutdown_connections 2024-04-26T17:59:38.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.721+0000 7f7e10319640 1 -- 172.21.15.12:0/3637030138 wait complete. 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 Processor -- start 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 -- start start 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080cb950 0x7f7e0814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e08153c50 0x7f7e081591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0815a310 con 0x7f7e080caab0 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e080cf4c0 con 0x7f7e08153c50 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e10319640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0815a5f0 con 0x7f7e080cb950 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e0e0b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e0e0b5640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59296/0 (socket says 172.21.15.12:59296) 2024-04-26T17:59:38.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.723+0000 7f7e0e0b5640 1 -- 172.21.15.12:0/1980959891 learned_addr learned my addr 172.21.15.12:0/1980959891 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0d8b4640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080cb950 0x7f7e0814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e8b6640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e08153c50 0x7f7e081591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 -- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080cb950 msgr2=0x7f7e0814e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080cb950 0x7f7e0814e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 -- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e08153c50 msgr2=0x7f7e081591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e08153c50 0x7f7e081591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 -- 172.21.15.12:0/1980959891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e080c8750 con 0x7f7e080caab0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e0e0b5640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c430 tx=0x7f7e0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e000074e0 con 0x7f7e080caab0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e000047e0 con 0x7f7e080caab0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e00004bd0 con 0x7f7e080caab0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e081f2560 con 0x7f7e080caab0 2024-04-26T17:59:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.724+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e080c8cd0 con 0x7f7e080caab0 2024-04-26T17:59:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.725+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08069ae0 con 0x7f7e080caab0 2024-04-26T17:59:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.726+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e00011070 con 0x7f7e080caab0 2024-04-26T17:59:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.726+0000 7f7e06ffd640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.726+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f7e0008b980 con 0x7f7e080caab0 2024-04-26T17:59:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.726+0000 7f7e0d8b4640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.727+0000 7f7e0d8b4640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 0x7f7df406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.732+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e000593f0 con 0x7f7e080caab0 2024-04-26T17:59:38.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.959+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e08076d20 con 0x7f7e080caab0 2024-04-26T17:59:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.960+0000 7f7e06ffd640 1 -- 172.21.15.12:0/1980959891 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f7e0005d6f0 con 0x7f7e080caab0 2024-04-26T17:59:38.960 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T17:59:38.960 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T17:59:38.960 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T17:59:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 msgr2=0x7f7df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 0x7f7df406edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034000 tx=0x7f7dfc02e000 comp rx=0 tx=0).stop 2024-04-26T17:59:38.962 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 msgr2=0x7f7e0814e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000c430 tx=0x7f7e0000c8f0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 shutdown_connections 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e08153c50 0x7f7e081591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7df406c8f0 0x7f7df406edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e080cb950 0x7f7e0814e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 --2- 172.21.15.12:0/1980959891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e080caab0 0x7f7e0814e920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 >> 172.21.15.12:0/1980959891 conn(0x7f7e08071bf0 msgr2=0x7f7e080c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 shutdown_connections 2024-04-26T17:59:38.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:38.962+0000 7f7e10319640 1 -- 172.21.15.12:0/1980959891 wait complete. 2024-04-26T17:59:38.974 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-04-26T17:59:38.974 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-04-26T17:59:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.086+0000 7fa2782f1640 1 Processor -- start 2024-04-26T17:59:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.086+0000 7fa2782f1640 1 -- start start 2024-04-26T17:59:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa2782f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2700caba0 0x7fa2700caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa2782f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 0x7fa27015f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa2782f1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2701563b0 con 0x7fa27006cb20 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa2782f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa27015c670 con 0x7fa2700caba0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa2782f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa2700b0f60 con 0x7fa27006c4a0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2700caba0 0x7fa2700caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa2700caba0 0x7fa2700caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59298/0 (socket says 172.21.15.12:59298) 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 -- 172.21.15.12:0/640577907 learned_addr learned my addr 172.21.15.12:0/640577907 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27588c640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 0x7fa27015f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 -- 172.21.15.12:0/640577907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 msgr2=0x7fa27015f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 0x7fa27015f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 -- 172.21.15.12:0/640577907 >> v1:172.21.15.100:6789/0 conn(0x7fa27006cb20 legacy=0x7fa270068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27608d640 1 -- 172.21.15.12:0/640577907 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2700b0c80 con 0x7fa2700caba0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.087+0000 7fa27588c640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 0x7fa27015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.088+0000 7fa27608d640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2700caba0 0x7fa2700caf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009870 tx=0x7fa26c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e338505eff6b93ab server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.088+0000 7fa27508b640 1 -- 172.21.15.12:0/640577907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c037070 con 0x7fa2700caba0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.088+0000 7fa27508b640 1 -- 172.21.15.12:0/640577907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26c032440 con 0x7fa2700caba0 2024-04-26T17:59:39.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.088+0000 7fa27508b640 1 -- 172.21.15.12:0/640577907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c032810 con 0x7fa2700caba0 2024-04-26T17:59:39.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 -- 172.21.15.12:0/640577907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2700caba0 msgr2=0x7fa2700caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2700caba0 0x7fa2700caf80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009870 tx=0x7fa26c02a2a0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 -- 172.21.15.12:0/640577907 shutdown_connections 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006c4a0 0x7fa27015f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 --2- 172.21.15.12:0/640577907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2700caba0 0x7fa2700caf80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 -- 172.21.15.12:0/640577907 >> 172.21.15.12:0/640577907 conn(0x7fa270070a50 msgr2=0x7fa270070e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 -- 172.21.15.12:0/640577907 shutdown_connections 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.089+0000 7fa2782f1640 1 -- 172.21.15.12:0/640577907 wait complete. 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.090+0000 7fa2782f1640 1 Processor -- start 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.090+0000 7fa2782f1640 1 -- start start 2024-04-26T17:59:39.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006cb20 0x7fa2700b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2700caba0 0x7fa2701f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa27015c300 con 0x7fa27006c4a0 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa27015c020 con 0x7fa2700caba0 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa2782f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa27015cb00 con 0x7fa27006cb20 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59300/0 (socket says 172.21.15.12:59300) 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 -- 172.21.15.12:0/544820496 learned_addr learned my addr 172.21.15.12:0/544820496 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27588c640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006cb20 0x7fa2700b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27688e640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2700caba0 0x7fa2701f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 -- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006cb20 msgr2=0x7fa2700b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006cb20 0x7fa2700b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 -- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2700caba0 msgr2=0x7fa2701f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2700caba0 0x7fa2701f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 -- 172.21.15.12:0/544820496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2700c4df0 con 0x7fa27006c4a0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.091+0000 7fa27608d640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009870 tx=0x7fa26c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.092+0000 7fa266ffd640 1 -- 172.21.15.12:0/544820496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c041070 con 0x7fa27006c4a0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.092+0000 7fa266ffd640 1 -- 172.21.15.12:0/544820496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26c03c870 con 0x7fa27006c4a0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.092+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2700c7520 con 0x7fa27006c4a0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.092+0000 7fa266ffd640 1 -- 172.21.15.12:0/544820496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c037040 con 0x7fa27006c4a0 2024-04-26T17:59:39.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.092+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2700c7ae0 con 0x7fa27006c4a0 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.093+0000 7fa266ffd640 1 -- 172.21.15.12:0/544820496 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa26c044070 con 0x7fa27006c4a0 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.094+0000 7fa266ffd640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 0x7fa25406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.094+0000 7fa266ffd640 1 -- 172.21.15.12:0/544820496 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa26c0acbe0 con 0x7fa27006c4a0 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.094+0000 7fa27588c640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 0x7fa25406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.094+0000 7fa27588c640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 0x7fa25406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2701e7c00 tx=0x7fa260008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.095+0000 7fa27b009740 1 Processor -- start 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.095+0000 7fa27b009740 1 -- start start 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 0x55eeb45175a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eeb443bd80 con 0x55eeb4517ae0 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eeb43d7c20 con 0x55eeb44d85e0 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55eeb4437d40 con 0x55eeb44d9b40 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59304/0 (socket says 172.21.15.12:59304) 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 -- 172.21.15.12:0/3312623418 learned_addr learned my addr 172.21.15.12:0/3312623418 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27608d640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 0x55eeb45175a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27688e640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 -- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 msgr2=0x55eeb44d8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 -- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 msgr2=0x55eeb45175a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 0x55eeb45175a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 -- 172.21.15.12:0/3312623418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb4219d80 con 0x55eeb4517ae0 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27608d640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 0x55eeb45175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa27588c640 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa2600043e0 tx=0x7fa260012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7297dac0d501060 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa253fff640 1 -- 172.21.15.12:0/3312623418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26001b050 con 0x55eeb4517ae0 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.096+0000 7fa253fff640 1 -- 172.21.15.12:0/3312623418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa260025070 con 0x55eeb4517ae0 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa253fff640 1 -- 172.21.15.12:0/3312623418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa260013460 con 0x55eeb4517ae0 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 -- 172.21.15.12:0/3312623418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 msgr2=0x55eeb44d89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa2600043e0 tx=0x7fa260012000 comp rx=0 tx=0).stop 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 -- 172.21.15.12:0/3312623418 shutdown_connections 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 --2- 172.21.15.12:0/3312623418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d85e0 0x55eeb45175a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 -- 172.21.15.12:0/3312623418 >> 172.21.15.12:0/3312623418 conn(0x55eeb449f740 msgr2=0x55eeb451c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 -- 172.21.15.12:0/3312623418 shutdown_connections 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.097+0000 7fa27b009740 1 -- 172.21.15.12:0/3312623418 wait complete. 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.098+0000 7fa27b009740 1 -- start start 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.098+0000 7fa27b009740 1 Processor -- start 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb4517ae0 0x55eeb4529270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55eeb44d6c20 con 0x55eeb44d85e0 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55eeb43d5840 con 0x55eeb4517ae0 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55eeb44da170 con 0x55eeb44d9b40 2024-04-26T17:59:39.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27b009740 10 client.0 _ll_register_callbacks cb 0x55eeb43d95b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59314/0 (socket says 172.21.15.12:59314) 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 -- 172.21.15.12:0/2246871222 learned_addr learned my addr 172.21.15.12:0/2246871222 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27688e640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb4517ae0 0x55eeb4529270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27588c640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 -- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 msgr2=0x55eeb44d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 -- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb4517ae0 msgr2=0x55eeb4529270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb4517ae0 0x55eeb4529270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.099+0000 7fa27608d640 1 -- 172.21.15.12:0/2246871222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb427a510 con 0x55eeb44d85e0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27608d640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa26c035040 tx=0x7fa26c07a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdf2933a09a21c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c04b040 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa26c07ab40 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa260025070 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa26c082d80 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 10 client.4863 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55eeb410d670 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa260025070 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa26c07fb70 con 0x55eeb44d85e0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 10 client.4863 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 10 client.4863 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 20 client.4863 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb44ffea0 0x55eeb45002a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 4 client.4863 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.100+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eeb4449990 con 0x55eeb44ffea0 2024-04-26T17:59:39.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.101+0000 7fa27588c640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb44ffea0 0x55eeb45002a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.101+0000 7fa27588c640 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb44ffea0 0x55eeb45002a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d080e2543915cea4 server_cookie=fb1e214901c1cdd2 in_seq=0 out_seq=0 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.101+0000 7fa2517fa640 10 client.4863 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa2517fa640 1 -- 172.21.15.12:0/2246871222 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55eeb4449990 con 0x55eeb44ffea0 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa2517fa640 10 client.4863 handle_command_reply: tid=0 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 client.4863 shutdown 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 msgr2=0x55eeb4510ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa26c035040 tx=0x7fa26c07a6e0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 shutdown_connections 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb44ffea0 0x55eeb45002a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb4517ae0 0x55eeb4529270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d9b40 0x55eeb44d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa2517fa640 0 client.4863 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 --2- 172.21.15.12:0/2246871222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4510ae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 >> 172.21.15.12:0/2246871222 conn(0x55eeb449f740 msgr2=0x55eeb44d9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 shutdown_connections 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 1 -- 172.21.15.12:0/2246871222 wait complete. 2024-04-26T17:59:39.110 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.102+0000 7fa27b009740 20 client.4863 trim_cache size 0 max 16384 2024-04-26T17:59:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 Processor -- start 2024-04-26T17:59:39.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 -- start start 2024-04-26T17:59:39.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d85e0 0x55eeb451c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb451cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2702006e0 con 0x55eeb4517ae0 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2701ff5c0 con 0x55eeb44d9b40 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa2700c3ec0 con 0x55eeb44d85e0 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27688e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27688e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59318/0 (socket says 172.21.15.12:59318) 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.120+0000 7fa27688e640 1 -- 172.21.15.12:0/2879390693 learned_addr learned my addr 172.21.15.12:0/2879390693 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27608d640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d85e0 0x55eeb451c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27588c640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb451cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 -- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d85e0 msgr2=0x55eeb451c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d85e0 0x55eeb451c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 -- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 msgr2=0x55eeb451cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb451cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 -- 172.21.15.12:0/2879390693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eeb451c6b0 con 0x55eeb4517ae0 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27588c640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb451cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa27688e640 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa268005810 tx=0x7fa268015780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6aebadf7860060 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa2537fe640 1 -- 172.21.15.12:0/2879390693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268006d60 con 0x55eeb4517ae0 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa2537fe640 1 -- 172.21.15.12:0/2879390693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26801a030 con 0x55eeb4517ae0 2024-04-26T17:59:39.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.121+0000 7fa2537fe640 1 -- 172.21.15.12:0/2879390693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa268007270 con 0x55eeb4517ae0 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 -- 172.21.15.12:0/2879390693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 msgr2=0x55eeb44d89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa268005810 tx=0x7fa268015780 comp rx=0 tx=0).stop 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 -- 172.21.15.12:0/2879390693 shutdown_connections 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb4517ae0 0x55eeb44d89c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb451cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 --2- 172.21.15.12:0/2879390693 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb44d85e0 0x55eeb451c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 -- 172.21.15.12:0/2879390693 >> 172.21.15.12:0/2879390693 conn(0x55eeb449f740 msgr2=0x55eeb4510020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 -- 172.21.15.12:0/2879390693 shutdown_connections 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.122+0000 7fa27b009740 1 -- 172.21.15.12:0/2879390693 wait complete. 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.123+0000 7fa27b009740 1 -- start start 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.123+0000 7fa27b009740 1 Processor -- start 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb44d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 0x55eeb44d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa2701fe170 con 0x55eeb44d85e0 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa2701feef0 con 0x55eeb44d9b40 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa2701fe820 con 0x55eeb4517ae0 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 10 client.0 _ll_register_callbacks cb 0x7fa26c076a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59320/0 (socket says 172.21.15.12:59320) 2024-04-26T17:59:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 -- 172.21.15.12:0/43825315 learned_addr learned my addr 172.21.15.12:0/43825315 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27588c640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb44d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27688e640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 0x55eeb44d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 -- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 msgr2=0x55eeb44d8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 0x55eeb44d8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 -- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 msgr2=0x55eeb44d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb44d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 -- 172.21.15.12:0/43825315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eeb44d97a0 con 0x55eeb44d85e0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27688e640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 0x55eeb44d8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27608d640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa26c07a670 tx=0x7fa26c0aabe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe324be2b762ef7f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa2517fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c04b040 con 0x55eeb44d85e0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fa26c07a940 con 0x55eeb44d85e0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.124+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa26801a030 con 0x55eeb44d85e0 2024-04-26T17:59:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa26c07ab60 con 0x55eeb44d85e0 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 10 client.4869 fetch_fsmap learned FSMap version 9 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55eeb44d97a0 con 0x55eeb44d85e0 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa26801a030 con 0x55eeb44d85e0 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa26c079b30 con 0x55eeb44d85e0 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 10 client.4869 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 10 client.4869 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 20 client.4869 populate_metadata read hostname 'smithi012' 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb458d170 0x55eeb458d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 4 client.4869 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55eeb4443800 con 0x55eeb458d170 2024-04-26T17:59:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.125+0000 7fa27588c640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb458d170 0x55eeb458d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.126+0000 7fa27588c640 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb458d170 0x55eeb458d550 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd2dfb70f6f8f507 server_cookie=97c76aafeb3f4e1b in_seq=0 out_seq=0 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.126+0000 7fa2517fa640 10 client.4869 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa2517fa640 1 -- 172.21.15.12:0/43825315 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55eeb4443800 con 0x55eeb458d170 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa2517fa640 10 client.4869 handle_command_reply: tid=0 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 client.4869 shutdown 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 msgr2=0x55eeb4511a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa26c07a670 tx=0x7fa26c0aabe0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 shutdown_connections 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55eeb4517ae0 0x55eeb44d8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55eeb458d170 0x55eeb458d550 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55eeb44d9b40 0x55eeb44d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 --2- 172.21.15.12:0/43825315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55eeb44d85e0 0x55eeb4511a00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa2517fa640 0 client.4869 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 >> 172.21.15.12:0/43825315 conn(0x55eeb449f740 msgr2=0x55eeb451c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 shutdown_connections 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 1 -- 172.21.15.12:0/43825315 wait complete. 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.127+0000 7fa27b009740 20 client.4869 trim_cache size 0 max 16384 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 6, 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "44e0527c": { 2024-04-26T17:59:39.133 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 6, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 90.0, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T17:59:39.134 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T17:59:39.135 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 msgr2=0x7fa25406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 0x7fa25406edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa2701e7c00 tx=0x7fa260008040 comp rx=0 tx=0).stop 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 msgr2=0x7fa2700c4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009870 tx=0x7fa26c0046c0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 shutdown_connections 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2700caba0 0x7fa2701f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa25406c8f0 0x7fa25406edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa27006cb20 0x7fa2700b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 --2- 172.21.15.12:0/544820496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27006c4a0 0x7fa2700c4740 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T17:59:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 >> 172.21.15.12:0/544820496 conn(0x7fa270070a50 msgr2=0x7fa270151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T17:59:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 shutdown_connections 2024-04-26T17:59:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T17:59:39.128+0000 7fa2782f1640 1 -- 172.21.15.12:0/544820496 wait complete. 2024-04-26T17:59:39.139 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '44e0527c', quiesce took 0.5 seconds. Will release after: 30.0 2024-04-26T17:59:43.868 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T17:59:43.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:09.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:00:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.299+0000 7f25aa996640 1 Processor -- start 2024-04-26T18:00:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.300+0000 7f25aa996640 1 -- start start 2024-04-26T18:00:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25aa996640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25aa996640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f25a40cd840 0x7f25a40c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25aa996640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a415f2a0 con 0x7f25a4156180 2024-04-26T18:00:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25aa996640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f25a415cbc0 con 0x7f25a40cd840 2024-04-26T18:00:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25aa996640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f25a40cc730 con 0x7f25a4155da0 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25a37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f25a4156180 0x7f25a40d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56882/0 (socket says 172.21.15.12:56882) 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25a37fe640 1 -- 172.21.15.12:0/583380343 learned_addr learned my addr 172.21.15.12:0/583380343 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25a8f33640 1 --2- 172.21.15.12:0/583380343 >> v2:172.21.15.100:3300/0 conn(0x7f25a40cd840 0x7f25a40c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.301+0000 7f25a3fff640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a8f33640 1 -- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 msgr2=0x7f25a415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a8f33640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a8f33640 1 -- 172.21.15.12:0/583380343 >> v1:172.21.15.12:6789/0 conn(0x7f25a4156180 legacy=0x7f25a40d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a2ffd640 1 -- 172.21.15.12:0/583380343 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419822984 0 0) 0x7f25a415f2a0 con 0x7f25a4156180 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a8f33640 1 -- 172.21.15.12:0/583380343 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a415f580 con 0x7f25a40cd840 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.302+0000 7f25a3fff640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.303+0000 7f25a8f33640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a40cd840 0x7f25a40c62a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f259c009d90 tx=0x7f259c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acf0173dd94e3081 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.303+0000 7f25a2ffd640 1 -- 172.21.15.12:0/583380343 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c031600 con 0x7f25a40cd840 2024-04-26T18:00:09.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.303+0000 7f25a2ffd640 1 -- 172.21.15.12:0/583380343 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c0317a0 con 0x7f25a40cd840 2024-04-26T18:00:09.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.303+0000 7f25a2ffd640 1 -- 172.21.15.12:0/583380343 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c031b70 con 0x7f25a40cd840 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 -- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a40cd840 msgr2=0x7f25a40c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a40cd840 0x7f25a40c62a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f259c009d90 tx=0x7f259c02a5d0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 -- 172.21.15.12:0/583380343 shutdown_connections 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a40cd840 0x7f25a40c62a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 --2- 172.21.15.12:0/583380343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 -- 172.21.15.12:0/583380343 >> 172.21.15.12:0/583380343 conn(0x7f25a4068090 msgr2=0x7f25a40684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 -- 172.21.15.12:0/583380343 shutdown_connections 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.304+0000 7f25aa996640 1 -- 172.21.15.12:0/583380343 wait complete. 2024-04-26T18:00:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.306+0000 7f25aa996640 1 Processor -- start 2024-04-26T18:00:09.307 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.306+0000 7f25aa996640 1 -- start start 2024-04-26T18:00:09.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a415a6c0 0x7f25a41f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40d19d0 con 0x7f25a40cd840 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f25a415fb40 con 0x7f25a415a6c0 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25aa996640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f25a40d1b50 con 0x7f25a4155da0 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25a3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25a3fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34866/0 (socket says 172.21.15.12:34866) 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25a3fff640 1 -- 172.21.15.12:0/3700340796 learned_addr learned my addr 172.21.15.12:0/3700340796 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.307+0000 7f25a37fe640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a8f33640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a415a6c0 0x7f25a41f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 -- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 msgr2=0x7f25a415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 -- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a415a6c0 msgr2=0x7f25a41f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a415a6c0 0x7f25a41f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 -- 172.21.15.12:0/3700340796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a415abb0 con 0x7f25a40cd840 2024-04-26T18:00:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a3fff640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f259400eca0 tx=0x7f259400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594017070 con 0x7f25a40cd840 2024-04-26T18:00:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259400cbd0 con 0x7f25a40cd840 2024-04-26T18:00:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a415ae90 con 0x7f25a40cd840 2024-04-26T18:00:09.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.308+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594013470 con 0x7f25a40cd840 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.309+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a415d5f0 con 0x7f25a40cd840 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.311+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f259401a070 con 0x7f25a40cd840 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.311+0000 7f25a0ff9640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 0x7f259006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.311+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a4076d20 con 0x7f25a40cd840 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.312+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f259408c140 con 0x7f25a40cd840 2024-04-26T18:00:09.312 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.312+0000 7f25a37fe640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 0x7f259006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.313 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.312+0000 7f25a37fe640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 0x7f259006ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2598007f70 tx=0x7f2598007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.321+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2594059b20 con 0x7f25a40cd840 2024-04-26T18:00:09.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.744+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25a40cd330 con 0x7f25a40cd840 2024-04-26T18:00:09.745 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.745+0000 7f25a0ff9640 1 -- 172.21.15.12:0/3700340796 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f259405de20 con 0x7f25a40cd840 2024-04-26T18:00:09.745 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:00:09.746 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:00:09.746 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:00:09.747 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 msgr2=0x7f259006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 0x7f259006ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2598007f70 tx=0x7f2598007f00 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 msgr2=0x7f25a415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f259400eca0 tx=0x7f259400c520 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 shutdown_connections 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f25a415a6c0 0x7f25a41f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f259006c920 0x7f259006ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f25a4155da0 0x7f25a415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 --2- 172.21.15.12:0/3700340796 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25a40cd840 0x7f25a415ddf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.748 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 >> 172.21.15.12:0/3700340796 conn(0x7f25a4068090 msgr2=0x7f25a40c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 shutdown_connections 2024-04-26T18:00:09.749 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.747+0000 7f25aa996640 1 -- 172.21.15.12:0/3700340796 wait complete. 2024-04-26T18:00:09.759 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 44e0527c --release --await' 2024-04-26T18:00:09.759 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 44e0527c --release --await 2024-04-26T18:00:09.867 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.867+0000 7f266cb46640 1 Processor -- start 2024-04-26T18:00:09.868 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.867+0000 7f266cb46640 1 -- start start 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2668071e50 0x7f26680c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f26680cfec0 0x7f26680b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f26680cae60 con 0x7f2668072230 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f2668159f60 con 0x7f26680cfec0 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.868+0000 7f266cb46640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f266815a240 con 0x7f2668071e50 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2666d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2666d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34882/0 (socket says 172.21.15.12:34882) 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2666d9d640 1 -- 172.21.15.12:0/3242460984 learned_addr learned my addr 172.21.15.12:0/3242460984 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.869 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f266659c640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2668071e50 0x7f26680c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.870 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 --2- 172.21.15.12:0/3242460984 >> v2:172.21.15.100:3300/0 conn(0x7f26680cfec0 0x7f26680b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 -- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2668071e50 msgr2=0x7f26680c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2668071e50 0x7f26680c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 -- 172.21.15.12:0/3242460984 >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 msgr2=0x7f26680b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 --2- 172.21.15.12:0/3242460984 >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2665d9b640 1 -- 172.21.15.12:0/3242460984 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266815a520 con 0x7f26680cfec0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.869+0000 7f2666d9d640 1 --2- 172.21.15.12:0/3242460984 >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.870+0000 7f2665d9b640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26680cfec0 0x7f26680b1a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097a0 tx=0x7f265c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8574a22d42b63c71 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.870+0000 7f266559a640 1 -- 172.21.15.12:0/3242460984 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c037070 con 0x7f26680cfec0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.870+0000 7f266559a640 1 -- 172.21.15.12:0/3242460984 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c032440 con 0x7f26680cfec0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.870+0000 7f266559a640 1 -- 172.21.15.12:0/3242460984 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c032810 con 0x7f26680cfec0 2024-04-26T18:00:09.871 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 -- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26680cfec0 msgr2=0x7f26680b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26680cfec0 0x7f26680b1a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f265c0097a0 tx=0x7f265c02a1c0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 -- 172.21.15.12:0/3242460984 shutdown_connections 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 --2- 172.21.15.12:0/3242460984 >> v2:172.21.15.12:3300/0 conn(0x7f2668072230 0x7f26680b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26680cfec0 0x7f26680b1a20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 --2- 172.21.15.12:0/3242460984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2668071e50 0x7f26680c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 -- 172.21.15.12:0/3242460984 >> 172.21.15.12:0/3242460984 conn(0x7f266806fe70 msgr2=0x7f2668070250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 -- 172.21.15.12:0/3242460984 shutdown_connections 2024-04-26T18:00:09.872 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.871+0000 7f266cb46640 1 -- 172.21.15.12:0/3242460984 wait complete. 2024-04-26T18:00:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.872+0000 7f266cb46640 1 Processor -- start 2024-04-26T18:00:09.873 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.872+0000 7f266cb46640 1 -- start start 2024-04-26T18:00:09.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2668072230 0x7f26681f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26680cfec0 0x7f26681f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f266815aae0 con 0x7f2668071e50 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2668159c30 con 0x7f2668072230 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266cb46640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f26680c4760 con 0x7f26680cfec0 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34890/0 (socket says 172.21.15.12:34890) 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f266659c640 1 -- 172.21.15.12:0/972553709 learned_addr learned my addr 172.21.15.12:0/972553709 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f2666d9d640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26680cfec0 0x7f26681f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.873+0000 7f2665d9b640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2668072230 0x7f26681f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 -- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26680cfec0 msgr2=0x7f26681f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.875 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26680cfec0 0x7f26681f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 -- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2668072230 msgr2=0x7f26681f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2668072230 0x7f26681f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 -- 172.21.15.12:0/972553709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26680b0170 con 0x7f2668071e50 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266659c640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f265800e9b0 tx=0x7f265800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f2656ffd640 1 -- 172.21.15.12:0/972553709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f2668071e50 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f2656ffd640 1 -- 172.21.15.12:0/972553709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265800c9a0 con 0x7f2668071e50 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f266806d650 con 0x7f2668071e50 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f2656ffd640 1 -- 172.21.15.12:0/972553709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265800cd90 con 0x7f2668071e50 2024-04-26T18:00:09.876 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.874+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f266806dc10 con 0x7f2668071e50 2024-04-26T18:00:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.876+0000 7f2656ffd640 1 -- 172.21.15.12:0/972553709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f265801a070 con 0x7f2668071e50 2024-04-26T18:00:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.876+0000 7f2656ffd640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 0x7f264806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.876+0000 7f2656ffd640 1 -- 172.21.15.12:0/972553709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f265808bf90 con 0x7f2668071e50 2024-04-26T18:00:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.877+0000 7f2665d9b640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 0x7f264806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.877 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.877+0000 7f2665d9b640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 0x7f264806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f265c034000 tx=0x7f265c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.877+0000 7f266f868740 1 Processor -- start 2024-04-26T18:00:09.878 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.878+0000 7f266f868740 1 -- start start 2024-04-26T18:00:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.880 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f922475dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f9223da040 con 0x55f9224b49b0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f922375b60 con 0x55f922476a10 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55f9223d6000 con 0x55f9224754b0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34900/0 (socket says 172.21.15.12:34900) 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 -- 172.21.15.12:0/2499130206 learned_addr learned my addr 172.21.15.12:0/2499130206 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2666d9d640 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f922475dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f266659c640 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 -- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 msgr2=0x55f9224b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 -- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 msgr2=0x55f922475dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f922475dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.879+0000 7f2665d9b640 1 -- 172.21.15.12:0/2499130206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f92236a9c0 con 0x55f9224b49b0 2024-04-26T18:00:09.881 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.880+0000 7f2665d9b640 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f265c009560 tx=0x7f265c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9664e02d1808f2c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.880+0000 7f2647fff640 1 -- 172.21.15.12:0/2499130206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c037040 con 0x55f9224b49b0 2024-04-26T18:00:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.880+0000 7f2647fff640 1 -- 172.21.15.12:0/2499130206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c032b70 con 0x55f9224b49b0 2024-04-26T18:00:09.882 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.880+0000 7f2647fff640 1 -- 172.21.15.12:0/2499130206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c03c440 con 0x55f9224b49b0 2024-04-26T18:00:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 -- 172.21.15.12:0/2499130206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 msgr2=0x55f922475890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f265c009560 tx=0x7f265c02c000 comp rx=0 tx=0).stop 2024-04-26T18:00:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 -- 172.21.15.12:0/2499130206 shutdown_connections 2024-04-26T18:00:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f922475dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.886 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f922475890 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 --2- 172.21.15.12:0/2499130206 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 -- 172.21.15.12:0/2499130206 >> 172.21.15.12:0/2499130206 conn(0x55f92243c930 msgr2=0x55f9224b9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.881+0000 7f266f868740 1 -- 172.21.15.12:0/2499130206 shutdown_connections 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.882+0000 7f266f868740 1 -- 172.21.15.12:0/2499130206 wait complete. 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.882+0000 7f266f868740 1 -- start start 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.882+0000 7f266f868740 1 Processor -- start 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.883+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.883+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f9224c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.883+0000 7f266f868740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f92249fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.883+0000 7f266f868740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f922473af0 con 0x55f9224b49b0 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f9223734f0 con 0x55f922476a10 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55f922477040 con 0x55f9224754b0 2024-04-26T18:00:09.887 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:60680/0 (socket says 172.21.15.12:60680) 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 -- 172.21.15.12:0/4200298798 learned_addr learned my addr 172.21.15.12:0/4200298798 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f2665d9b640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f9224c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266f868740 10 client.0 _ll_register_callbacks cb 0x55f9223d0c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f2666d9d640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f92249fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 -- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 msgr2=0x55f9224c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f9224c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 -- 172.21.15.12:0/4200298798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 msgr2=0x55f92249fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f92249fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 -- 172.21.15.12:0/4200298798 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f9220eb920 con 0x55f9224754b0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f2666d9d640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f92249fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f266659c640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265800e980 tx=0x7f2658059990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=816a4cf24e1c643e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.884+0000 7f26457fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3301/0 2024-04-26T18:00:09.888 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658088060 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mon.2 v2:172.21.15.100:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f2658089cb0 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f265c032b70 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2658076050 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 10 client.4628 fetch_fsmap learned FSMap version 9 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9221b7d30 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mon.2 v2:172.21.15.100:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c032b70 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mon.2 v2:172.21.15.100:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2658024060 con 0x55f9224754b0 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 10 client.4628 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 10 client.4628 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 20 client.4628 populate_metadata read hostname 'smithi012' 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f9224c8ef0 0x55f9224c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.889 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 4 client.4628 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:00:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9223ada00 con 0x55f9224c8ef0 2024-04-26T18:00:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.885+0000 7f2665d9b640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f9224c8ef0 0x55f9224c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.886+0000 7f26457fa640 10 client.4628 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:00:09.890 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.886+0000 7f2665d9b640 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f9224c8ef0 0x55f9224c92f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e59cf1752ef0687b server_cookie=dbb0d8927ff503af in_seq=0 out_seq=0 2024-04-26T18:00:09.891 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f26457fa640 1 -- 172.21.15.12:0/4200298798 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f9223ada00 con 0x55f9224c8ef0 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f26457fa640 10 client.4628 handle_command_reply: tid=0 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 client.4628 shutdown 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 msgr2=0x55f9224b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f265800e980 tx=0x7f2658059990 comp rx=0 tx=0).stop 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 shutdown_connections 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f9224b49b0 0x55f92249fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f9224c8ef0 0x55f9224c92f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f922476a10 0x55f9224c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 --2- 172.21.15.12:0/4200298798 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224b27c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 >> 172.21.15.12:0/4200298798 conn(0x55f92243c930 msgr2=0x55f92246f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f26457fa640 0 client.4628 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 shutdown_connections 2024-04-26T18:00:09.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 1 -- 172.21.15.12:0/4200298798 wait complete. 2024-04-26T18:00:09.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.887+0000 7f266f868740 20 client.4628 trim_cache size 0 max 16384 2024-04-26T18:00:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 Processor -- start 2024-04-26T18:00:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 -- start start 2024-04-26T18:00:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f92243c930 0x55f9224c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9224754b0 0x55f9224c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f26682005e0 con 0x55f922472550 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26681ff4c0 con 0x55f9224754b0 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.906+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f266814d010 con 0x55f92243c930 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34918/0 (socket says 172.21.15.12:34918) 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 -- 172.21.15.12:0/524245756 learned_addr learned my addr 172.21.15.12:0/524245756 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f2666d9d640 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9224754b0 0x55f9224c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f2665d9b640 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f92243c930 0x55f9224c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 -- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f92243c930 msgr2=0x55f9224c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f92243c930 0x55f9224c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 -- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9224754b0 msgr2=0x55f9224c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9224754b0 0x55f9224c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 -- 172.21.15.12:0/524245756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f922472c70 con 0x55f922472550 2024-04-26T18:00:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f266659c640 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2658009160 tx=0x7f265801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ac5dc9cdd4f571 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f26477fe640 1 -- 172.21.15.12:0/524245756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658021040 con 0x55f922472550 2024-04-26T18:00:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f26477fe640 1 -- 172.21.15.12:0/524245756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658058d20 con 0x55f922472550 2024-04-26T18:00:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.907+0000 7f26477fe640 1 -- 172.21.15.12:0/524245756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2658055620 con 0x55f922472550 2024-04-26T18:00:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 -- 172.21.15.12:0/524245756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 msgr2=0x55f92249d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2658009160 tx=0x7f265801e000 comp rx=0 tx=0).stop 2024-04-26T18:00:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 -- 172.21.15.12:0/524245756 shutdown_connections 2024-04-26T18:00:09.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f9224754b0 0x55f9224c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f92243c930 0x55f9224c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 --2- 172.21.15.12:0/524245756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f92249d8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 -- 172.21.15.12:0/524245756 >> 172.21.15.12:0/524245756 conn(0x55f92249fc40 msgr2=0x55f9224711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.908+0000 7f266f868740 1 -- 172.21.15.12:0/524245756 shutdown_connections 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.909+0000 7f266f868740 1 -- 172.21.15.12:0/524245756 wait complete. 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.909+0000 7f266f868740 1 -- start start 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 Processor -- start 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f92243c930 0x55f92252a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f26681fe100 con 0x55f922472550 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f26681fee20 con 0x55f92243c930 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f26681fe750 con 0x55f9224754b0 2024-04-26T18:00:09.916 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.910+0000 7f266f868740 10 client.0 _ll_register_callbacks cb 0x7f26600071f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34932/0 (socket says 172.21.15.12:34932) 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 -- 172.21.15.12:0/1848013046 learned_addr learned my addr 172.21.15.12:0/1848013046 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2666d9d640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 -- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 msgr2=0x55f9224c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 -- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f92243c930 msgr2=0x55f92252a340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f92243c930 0x55f92252a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 -- 172.21.15.12:0/1848013046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9224d9710 con 0x55f922472550 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f2665d9b640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f265c009890 tx=0x7f265c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a9df84727ddc32 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f26457fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:00:09.917 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c037040 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7f265c058190 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.911+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2658058d20 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f265c0583e0 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 10 client.4893 fetch_fsmap learned FSMap version 9 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f9224d8ed0 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2658058d20 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f265c058580 con 0x55f922472550 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 10 client.4893 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 10 client.4893 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 20 client.4893 populate_metadata read hostname 'smithi012' 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f922476a10 0x55f9224c5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:00:09.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 4 client.4893 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "44e0527c", "release": true, "await": true}] 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "44e0527c", "release": true, "await": true}) -- 0x55f9223e7c50 con 0x55f922476a10 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.912+0000 7f266659c640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f922476a10 0x55f9224c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266659c640 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f922476a10 0x55f9224c5050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5020cf23f3fae server_cookie=14b9c45d8d2ef270 in_seq=0 out_seq=0 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f26457fa640 10 client.4893 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f26457fa640 1 -- 172.21.15.12:0/1848013046 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55f9223e7c50 con 0x55f922476a10 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f26457fa640 10 client.4893 handle_command_reply: tid=0 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 client.4893 shutdown 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 msgr2=0x55f9224d87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f265c009890 tx=0x7f265c02c070 comp rx=0 tx=0).stop 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 shutdown_connections 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f9224754b0 0x55f9224c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f922472550 0x55f9224d87c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f922476a10 0x55f9224c5050 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 --2- 172.21.15.12:0/1848013046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f92243c930 0x55f92252a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f26457fa640 0 client.4893 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 >> 172.21.15.12:0/1848013046 conn(0x55f92249fc40 msgr2=0x55f9224b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 shutdown_connections 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.913+0000 7f266f868740 1 -- 172.21.15.12:0/1848013046 wait complete. 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:00:09.920 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 8, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "44e0527c": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 8, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 90.0, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:00:09.921 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:00:09.922 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:00:09.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266f868740 20 client.4893 trim_cache size 0 max 16384 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 msgr2=0x7f264806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 0x7f264806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f265c034000 tx=0x7f265c02e000 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 msgr2=0x7f26680b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f265800e9b0 tx=0x7f265800ee70 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 shutdown_connections 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f264806c8f0 0x7f264806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f26680cfec0 0x7f26681f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2668072230 0x7f26681f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 --2- 172.21.15.12:0/972553709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2668071e50 0x7f26680b42d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 >> 172.21.15.12:0/972553709 conn(0x7f266806fe70 msgr2=0x7f26680cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 shutdown_connections 2024-04-26T18:00:09.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:00:09.914+0000 7f266cb46640 1 -- 172.21.15.12:0/972553709 wait complete. 2024-04-26T18:00:09.929 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '44e0527c', seconds elapsed: 31.3 2024-04-26T18:00:13.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:13.942 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:15.376 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 92% (11405/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to 'bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1'. 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2024-04-26T18:00:16.020 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr: 2024-04-26T18:00:16.021 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at bc94a2a924f Merge commit 'refs/pull/57099/head' of github.com:ceph/ceph into quiescer 2024-04-26T18:00:16.026 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-26T18:00:16.048 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-26T18:00:16.050 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:00:16.050 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-26T18:00:16.586 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-26T18:00:16.638 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-26T18:00:16.678 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-26T18:00:16.680 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:00:16.680 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-26T18:00:16.718 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-26T18:00:16.722 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T18:00:16.722 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-26T18:00:16.778 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-04-26T18:00:16.779 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-04-26T18:00:16.779 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-04-26T18:00:16.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-26T18:00:19.468 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir foo 2024-04-26T18:00:19.472 INFO:tasks.workunit.client.0.smithi012.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-04-26T18:00:19.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir foo/.snap/barsnap 2024-04-26T18:00:19.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-04-26T18:00:19.528 INFO:tasks.workunit.client.0.smithi012.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-04-26T18:00:19.961 INFO:tasks.workunit.client.0.smithi012.stdout:passed: files are identical 2024-04-26T18:00:19.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'passed: files are identical' 2024-04-26T18:00:19.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir foo/.snap/barsnap 2024-04-26T18:00:19.969 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:00:19.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:00:19.970 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:00:19.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:00:20.044 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-04-26T18:00:20.044 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-04-26T18:00:20.105 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 1 2024-04-26T18:00:20.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 2 2024-04-26T18:00:20.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 3 2024-04-26T18:00:20.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -e file4 ']' 2024-04-26T18:00:20.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir .snap/snap1 2024-04-26T18:00:20.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 4 2024-04-26T18:00:20.123 INFO:tasks.workunit.client.0.smithi012.stderr:++ ls 2024-04-26T18:00:20.126 INFO:tasks.workunit.client.0.smithi012.stderr:+ now='file1 2024-04-26T18:00:20.126 INFO:tasks.workunit.client.0.smithi012.stderr:file2 2024-04-26T18:00:20.126 INFO:tasks.workunit.client.0.smithi012.stderr:file3 2024-04-26T18:00:20.126 INFO:tasks.workunit.client.0.smithi012.stderr:file4' 2024-04-26T18:00:20.132 INFO:tasks.workunit.client.0.smithi012.stderr:++ ls .snap/snap1 2024-04-26T18:00:20.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ then='file1 2024-04-26T18:00:20.132 INFO:tasks.workunit.client.0.smithi012.stderr:file2 2024-04-26T18:00:20.132 INFO:tasks.workunit.client.0.smithi012.stderr:file3' 2024-04-26T18:00:20.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir .snap/snap1 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 'file1 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:file2 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:file3 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:file4' = 'file1 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:file2 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:file3' ']' 2024-04-26T18:00:20.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 1 2024-04-26T18:00:20.141 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 2 2024-04-26T18:00:20.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 3 2024-04-26T18:00:20.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir .snap/snap1 2024-04-26T18:00:20.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 4 2024-04-26T18:00:20.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir .snap/snap1 2024-04-26T18:00:20.193 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm file1 file2 file3 file4 2024-04-26T18:00:20.200 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:00:20.201 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:00:20.201 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:00:20.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:00:20.271 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-04-26T18:00:20.271 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-04-26T18:00:20.331 INFO:tasks.workunit.client.0.smithi012.stdout:Create dir 100 to 199 ... 2024-04-26T18:00:20.336 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 100 2024-04-26T18:00:20.347 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 101 2024-04-26T18:00:20.359 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 102 2024-04-26T18:00:20.370 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 103 2024-04-26T18:00:20.381 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 104 2024-04-26T18:00:20.392 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 105 2024-04-26T18:00:20.404 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 106 2024-04-26T18:00:20.416 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 107 2024-04-26T18:00:20.427 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 108 2024-04-26T18:00:20.438 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 109 2024-04-26T18:00:20.450 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 110 2024-04-26T18:00:20.460 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 111 2024-04-26T18:00:20.473 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 112 2024-04-26T18:00:20.483 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 113 2024-04-26T18:00:20.496 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 114 2024-04-26T18:00:20.506 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 115 2024-04-26T18:00:20.517 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 116 2024-04-26T18:00:21.264 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 117 2024-04-26T18:00:21.277 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 118 2024-04-26T18:00:21.289 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 119 2024-04-26T18:00:21.561 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 120 2024-04-26T18:00:21.575 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 121 2024-04-26T18:00:21.588 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 122 2024-04-26T18:00:21.602 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 123 2024-04-26T18:00:21.613 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 124 2024-04-26T18:00:21.626 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 125 2024-04-26T18:00:21.639 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 126 2024-04-26T18:00:21.651 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 127 2024-04-26T18:00:21.664 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 128 2024-04-26T18:00:21.677 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 129 2024-04-26T18:00:21.689 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 130 2024-04-26T18:00:21.700 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 131 2024-04-26T18:00:21.714 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 132 2024-04-26T18:00:21.730 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 133 2024-04-26T18:00:21.745 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 134 2024-04-26T18:00:21.792 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 135 2024-04-26T18:00:21.808 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 136 2024-04-26T18:00:21.824 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 137 2024-04-26T18:00:21.841 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 138 2024-04-26T18:00:21.856 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 139 2024-04-26T18:00:21.872 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 140 2024-04-26T18:00:21.886 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 141 2024-04-26T18:00:21.899 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 142 2024-04-26T18:00:22.167 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 143 2024-04-26T18:00:22.178 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 144 2024-04-26T18:00:22.190 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 145 2024-04-26T18:00:22.202 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 146 2024-04-26T18:00:22.215 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 147 2024-04-26T18:00:22.732 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 148 2024-04-26T18:00:22.743 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 149 2024-04-26T18:00:22.756 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 150 2024-04-26T18:00:22.771 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 151 2024-04-26T18:00:22.784 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 152 2024-04-26T18:00:22.796 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 153 2024-04-26T18:00:22.810 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 154 2024-04-26T18:00:22.822 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 155 2024-04-26T18:00:22.835 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 156 2024-04-26T18:00:22.849 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 157 2024-04-26T18:00:22.863 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 158 2024-04-26T18:00:22.875 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 159 2024-04-26T18:00:22.887 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 160 2024-04-26T18:00:22.899 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 161 2024-04-26T18:00:22.911 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 162 2024-04-26T18:00:22.924 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 163 2024-04-26T18:00:22.936 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 164 2024-04-26T18:00:22.948 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 165 2024-04-26T18:00:22.960 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 166 2024-04-26T18:00:22.972 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 167 2024-04-26T18:00:22.986 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 168 2024-04-26T18:00:23.233 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 169 2024-04-26T18:00:23.250 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 170 2024-04-26T18:00:24.020 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 171 2024-04-26T18:00:24.034 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 172 2024-04-26T18:00:24.048 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 173 2024-04-26T18:00:24.061 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 174 2024-04-26T18:00:24.534 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 175 2024-04-26T18:00:24.551 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 176 2024-04-26T18:00:24.566 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 177 2024-04-26T18:00:24.579 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 178 2024-04-26T18:00:24.592 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 179 2024-04-26T18:00:24.605 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 180 2024-04-26T18:00:24.619 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 181 2024-04-26T18:00:24.634 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 182 2024-04-26T18:00:26.161 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 183 2024-04-26T18:00:26.175 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 184 2024-04-26T18:00:26.188 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 185 2024-04-26T18:00:26.203 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 186 2024-04-26T18:00:26.216 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 187 2024-04-26T18:00:26.229 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 188 2024-04-26T18:00:26.243 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 189 2024-04-26T18:00:26.273 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 190 2024-04-26T18:00:26.287 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 191 2024-04-26T18:00:26.300 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 192 2024-04-26T18:00:26.313 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 193 2024-04-26T18:00:26.326 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 194 2024-04-26T18:00:26.339 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 195 2024-04-26T18:00:26.352 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 196 2024-04-26T18:00:26.364 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 197 2024-04-26T18:00:26.376 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 198 2024-04-26T18:00:26.388 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 199 2024-04-26T18:00:26.667 INFO:tasks.workunit.client.0.smithi012.stdout:Take first snapshot .snap/test1 2024-04-26T18:00:27.026 INFO:tasks.workunit.client.0.smithi012.stdout:Create dir 200 to 299 ... 2024-04-26T18:00:27.032 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 200 2024-04-26T18:00:27.037 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 201 2024-04-26T18:00:27.050 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 202 2024-04-26T18:00:27.061 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 203 2024-04-26T18:00:27.072 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 204 2024-04-26T18:00:27.085 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 205 2024-04-26T18:00:27.097 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 206 2024-04-26T18:00:27.108 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 207 2024-04-26T18:00:27.120 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 208 2024-04-26T18:00:27.385 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 209 2024-04-26T18:00:27.397 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 210 2024-04-26T18:00:27.409 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 211 2024-04-26T18:00:27.421 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 212 2024-04-26T18:00:27.633 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 213 2024-04-26T18:00:27.646 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 214 2024-04-26T18:00:27.910 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 215 2024-04-26T18:00:27.922 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 216 2024-04-26T18:00:28.191 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 217 2024-04-26T18:00:28.204 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 218 2024-04-26T18:00:28.218 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 219 2024-04-26T18:00:28.230 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 220 2024-04-26T18:00:28.242 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 221 2024-04-26T18:00:28.254 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 222 2024-04-26T18:00:28.267 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 223 2024-04-26T18:00:28.279 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 224 2024-04-26T18:00:28.291 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 225 2024-04-26T18:00:28.304 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 226 2024-04-26T18:00:28.316 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 227 2024-04-26T18:00:28.328 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 228 2024-04-26T18:00:28.340 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 229 2024-04-26T18:00:28.351 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 230 2024-04-26T18:00:28.364 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 231 2024-04-26T18:00:28.516 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 232 2024-04-26T18:00:28.528 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 233 2024-04-26T18:00:28.540 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 234 2024-04-26T18:00:28.551 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 235 2024-04-26T18:00:28.563 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 236 2024-04-26T18:00:28.576 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 237 2024-04-26T18:00:28.587 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 238 2024-04-26T18:00:29.123 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 239 2024-04-26T18:00:29.265 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 240 2024-04-26T18:00:29.278 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 241 2024-04-26T18:00:29.291 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 242 2024-04-26T18:00:29.594 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 243 2024-04-26T18:00:29.696 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 244 2024-04-26T18:00:29.710 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 245 2024-04-26T18:00:29.723 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 246 2024-04-26T18:00:29.734 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 247 2024-04-26T18:00:29.746 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 248 2024-04-26T18:00:29.758 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 249 2024-04-26T18:00:30.470 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 250 2024-04-26T18:00:30.486 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 251 2024-04-26T18:00:34.514 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 252 2024-04-26T18:00:34.526 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 253 2024-04-26T18:00:34.538 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 254 2024-04-26T18:00:34.550 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 255 2024-04-26T18:00:34.562 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 256 2024-04-26T18:00:34.575 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 257 2024-04-26T18:00:34.587 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 258 2024-04-26T18:00:34.600 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 259 2024-04-26T18:00:34.613 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 260 2024-04-26T18:00:34.627 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 261 2024-04-26T18:00:34.637 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 262 2024-04-26T18:00:34.649 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 263 2024-04-26T18:00:34.661 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 264 2024-04-26T18:00:34.672 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 265 2024-04-26T18:00:34.684 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 266 2024-04-26T18:00:35.096 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 267 2024-04-26T18:00:35.109 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 268 2024-04-26T18:00:35.121 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 269 2024-04-26T18:00:35.133 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 270 2024-04-26T18:00:35.145 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 271 2024-04-26T18:00:35.158 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 272 2024-04-26T18:00:35.170 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 273 2024-04-26T18:00:35.182 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 274 2024-04-26T18:00:35.194 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 275 2024-04-26T18:00:35.206 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 276 2024-04-26T18:00:35.217 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 277 2024-04-26T18:00:35.229 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 278 2024-04-26T18:00:35.240 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 279 2024-04-26T18:00:35.252 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 280 2024-04-26T18:00:35.262 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 281 2024-04-26T18:00:35.274 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 282 2024-04-26T18:00:35.286 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 283 2024-04-26T18:00:35.297 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 284 2024-04-26T18:00:35.309 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 285 2024-04-26T18:00:35.319 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 286 2024-04-26T18:00:35.331 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 287 2024-04-26T18:00:35.343 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 288 2024-04-26T18:00:35.354 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 289 2024-04-26T18:00:35.365 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 290 2024-04-26T18:00:35.376 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 291 2024-04-26T18:00:35.387 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 292 2024-04-26T18:00:35.399 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 293 2024-04-26T18:00:35.410 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 294 2024-04-26T18:00:37.084 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 295 2024-04-26T18:00:37.098 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 296 2024-04-26T18:00:37.111 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 297 2024-04-26T18:00:37.124 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 298 2024-04-26T18:00:37.137 INFO:tasks.workunit.client.0.smithi012.stdout: create dir 299 2024-04-26T18:00:37.150 INFO:tasks.workunit.client.0.smithi012.stdout:Create a snapshot in every first level dir ... 2024-04-26T18:00:37.685 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/.snap/snap-subdir-test 2024-04-26T18:00:37.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/30 file after the snapshot 2024-04-26T18:00:37.695 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/31 file after the snapshot 2024-04-26T18:00:37.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/32 file after the snapshot 2024-04-26T18:00:37.697 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/33 file after the snapshot 2024-04-26T18:00:37.699 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/34 file after the snapshot 2024-04-26T18:00:37.706 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/35 file after the snapshot 2024-04-26T18:00:37.709 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/36 file after the snapshot 2024-04-26T18:00:37.711 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/37 file after the snapshot 2024-04-26T18:00:37.711 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/38 file after the snapshot 2024-04-26T18:00:37.712 INFO:tasks.workunit.client.0.smithi012.stdout: create 100/39 file after the snapshot 2024-04-26T18:00:37.713 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/.snap/snap-subdir-test 2024-04-26T18:00:37.734 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/30 file after the snapshot 2024-04-26T18:00:37.736 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/31 file after the snapshot 2024-04-26T18:00:37.739 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/32 file after the snapshot 2024-04-26T18:00:37.745 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/33 file after the snapshot 2024-04-26T18:00:37.749 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/34 file after the snapshot 2024-04-26T18:00:37.750 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/35 file after the snapshot 2024-04-26T18:00:37.751 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/36 file after the snapshot 2024-04-26T18:00:37.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/37 file after the snapshot 2024-04-26T18:00:37.754 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/38 file after the snapshot 2024-04-26T18:00:37.755 INFO:tasks.workunit.client.0.smithi012.stdout: create 101/39 file after the snapshot 2024-04-26T18:00:37.755 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/.snap/snap-subdir-test 2024-04-26T18:00:37.771 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/30 file after the snapshot 2024-04-26T18:00:37.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/31 file after the snapshot 2024-04-26T18:00:37.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/32 file after the snapshot 2024-04-26T18:00:37.774 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/33 file after the snapshot 2024-04-26T18:00:37.776 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/34 file after the snapshot 2024-04-26T18:00:37.780 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/35 file after the snapshot 2024-04-26T18:00:37.787 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/36 file after the snapshot 2024-04-26T18:00:37.788 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/37 file after the snapshot 2024-04-26T18:00:37.788 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/38 file after the snapshot 2024-04-26T18:00:37.789 INFO:tasks.workunit.client.0.smithi012.stdout: create 102/39 file after the snapshot 2024-04-26T18:00:37.790 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/.snap/snap-subdir-test 2024-04-26T18:00:37.808 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/30 file after the snapshot 2024-04-26T18:00:37.812 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/31 file after the snapshot 2024-04-26T18:00:37.818 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/32 file after the snapshot 2024-04-26T18:00:37.820 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/33 file after the snapshot 2024-04-26T18:00:37.820 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/34 file after the snapshot 2024-04-26T18:00:37.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/35 file after the snapshot 2024-04-26T18:00:38.074 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/36 file after the snapshot 2024-04-26T18:00:38.075 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/37 file after the snapshot 2024-04-26T18:00:38.076 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/38 file after the snapshot 2024-04-26T18:00:38.077 INFO:tasks.workunit.client.0.smithi012.stdout: create 103/39 file after the snapshot 2024-04-26T18:00:38.078 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/.snap/snap-subdir-test 2024-04-26T18:00:38.637 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/30 file after the snapshot 2024-04-26T18:00:38.639 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/31 file after the snapshot 2024-04-26T18:00:38.640 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/32 file after the snapshot 2024-04-26T18:00:38.643 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/33 file after the snapshot 2024-04-26T18:00:38.647 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/34 file after the snapshot 2024-04-26T18:00:38.656 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/35 file after the snapshot 2024-04-26T18:00:38.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/36 file after the snapshot 2024-04-26T18:00:38.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/37 file after the snapshot 2024-04-26T18:00:38.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/38 file after the snapshot 2024-04-26T18:00:38.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 104/39 file after the snapshot 2024-04-26T18:00:38.660 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/.snap/snap-subdir-test 2024-04-26T18:00:38.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/30 file after the snapshot 2024-04-26T18:00:38.682 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/31 file after the snapshot 2024-04-26T18:00:38.683 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/32 file after the snapshot 2024-04-26T18:00:38.683 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/33 file after the snapshot 2024-04-26T18:00:38.684 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/34 file after the snapshot 2024-04-26T18:00:38.686 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/35 file after the snapshot 2024-04-26T18:00:38.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/36 file after the snapshot 2024-04-26T18:00:38.697 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/37 file after the snapshot 2024-04-26T18:00:38.698 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/38 file after the snapshot 2024-04-26T18:00:38.699 INFO:tasks.workunit.client.0.smithi012.stdout: create 105/39 file after the snapshot 2024-04-26T18:00:38.700 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/.snap/snap-subdir-test 2024-04-26T18:00:38.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/30 file after the snapshot 2024-04-26T18:00:38.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/31 file after the snapshot 2024-04-26T18:00:38.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/32 file after the snapshot 2024-04-26T18:00:38.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/33 file after the snapshot 2024-04-26T18:00:38.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/34 file after the snapshot 2024-04-26T18:00:38.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/35 file after the snapshot 2024-04-26T18:00:38.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/36 file after the snapshot 2024-04-26T18:00:38.733 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/37 file after the snapshot 2024-04-26T18:00:38.734 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/38 file after the snapshot 2024-04-26T18:00:38.735 INFO:tasks.workunit.client.0.smithi012.stdout: create 106/39 file after the snapshot 2024-04-26T18:00:38.736 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/.snap/snap-subdir-test 2024-04-26T18:00:38.752 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/30 file after the snapshot 2024-04-26T18:00:38.754 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/31 file after the snapshot 2024-04-26T18:00:38.755 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/32 file after the snapshot 2024-04-26T18:00:38.758 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/33 file after the snapshot 2024-04-26T18:00:38.763 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/34 file after the snapshot 2024-04-26T18:00:38.766 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/35 file after the snapshot 2024-04-26T18:00:38.769 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/36 file after the snapshot 2024-04-26T18:00:38.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/37 file after the snapshot 2024-04-26T18:00:38.771 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/38 file after the snapshot 2024-04-26T18:00:38.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 107/39 file after the snapshot 2024-04-26T18:00:38.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/.snap/snap-subdir-test 2024-04-26T18:00:38.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/30 file after the snapshot 2024-04-26T18:00:38.798 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/31 file after the snapshot 2024-04-26T18:00:38.808 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/32 file after the snapshot 2024-04-26T18:00:39.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/33 file after the snapshot 2024-04-26T18:00:39.187 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/34 file after the snapshot 2024-04-26T18:00:39.188 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/35 file after the snapshot 2024-04-26T18:00:39.190 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/36 file after the snapshot 2024-04-26T18:00:39.191 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/37 file after the snapshot 2024-04-26T18:00:39.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/38 file after the snapshot 2024-04-26T18:00:39.193 INFO:tasks.workunit.client.0.smithi012.stdout: create 108/39 file after the snapshot 2024-04-26T18:00:39.194 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/.snap/snap-subdir-test 2024-04-26T18:00:39.213 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/30 file after the snapshot 2024-04-26T18:00:39.214 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/31 file after the snapshot 2024-04-26T18:00:39.216 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/32 file after the snapshot 2024-04-26T18:00:39.218 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/33 file after the snapshot 2024-04-26T18:00:39.220 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/34 file after the snapshot 2024-04-26T18:00:39.228 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/35 file after the snapshot 2024-04-26T18:00:39.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/36 file after the snapshot 2024-04-26T18:00:39.686 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/37 file after the snapshot 2024-04-26T18:00:39.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/38 file after the snapshot 2024-04-26T18:00:39.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 109/39 file after the snapshot 2024-04-26T18:00:39.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/.snap/snap-subdir-test 2024-04-26T18:00:39.700 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/30 file after the snapshot 2024-04-26T18:00:39.701 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/31 file after the snapshot 2024-04-26T18:00:39.702 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/32 file after the snapshot 2024-04-26T18:00:39.703 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/33 file after the snapshot 2024-04-26T18:00:39.705 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/34 file after the snapshot 2024-04-26T18:00:39.712 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/35 file after the snapshot 2024-04-26T18:00:39.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/36 file after the snapshot 2024-04-26T18:00:39.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/37 file after the snapshot 2024-04-26T18:00:39.718 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/38 file after the snapshot 2024-04-26T18:00:39.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 110/39 file after the snapshot 2024-04-26T18:00:39.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/.snap/snap-subdir-test 2024-04-26T18:00:39.737 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/30 file after the snapshot 2024-04-26T18:00:39.738 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/31 file after the snapshot 2024-04-26T18:00:39.740 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/32 file after the snapshot 2024-04-26T18:00:39.741 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/33 file after the snapshot 2024-04-26T18:00:39.745 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/34 file after the snapshot 2024-04-26T18:00:39.752 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/35 file after the snapshot 2024-04-26T18:00:39.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/36 file after the snapshot 2024-04-26T18:00:39.754 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/37 file after the snapshot 2024-04-26T18:00:39.755 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/38 file after the snapshot 2024-04-26T18:00:39.756 INFO:tasks.workunit.client.0.smithi012.stdout: create 111/39 file after the snapshot 2024-04-26T18:00:40.011 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/.snap/snap-subdir-test 2024-04-26T18:00:40.026 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/30 file after the snapshot 2024-04-26T18:00:40.028 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/31 file after the snapshot 2024-04-26T18:00:40.029 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/32 file after the snapshot 2024-04-26T18:00:40.030 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/33 file after the snapshot 2024-04-26T18:00:40.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/34 file after the snapshot 2024-04-26T18:00:40.037 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/35 file after the snapshot 2024-04-26T18:00:40.042 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/36 file after the snapshot 2024-04-26T18:00:40.044 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/37 file after the snapshot 2024-04-26T18:00:40.045 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/38 file after the snapshot 2024-04-26T18:00:40.045 INFO:tasks.workunit.client.0.smithi012.stdout: create 112/39 file after the snapshot 2024-04-26T18:00:40.046 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/.snap/snap-subdir-test 2024-04-26T18:00:40.064 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/30 file after the snapshot 2024-04-26T18:00:40.066 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/31 file after the snapshot 2024-04-26T18:00:40.067 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/32 file after the snapshot 2024-04-26T18:00:40.068 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/33 file after the snapshot 2024-04-26T18:00:40.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/34 file after the snapshot 2024-04-26T18:00:40.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/35 file after the snapshot 2024-04-26T18:00:40.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/36 file after the snapshot 2024-04-26T18:00:40.085 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/37 file after the snapshot 2024-04-26T18:00:40.086 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/38 file after the snapshot 2024-04-26T18:00:40.087 INFO:tasks.workunit.client.0.smithi012.stdout: create 113/39 file after the snapshot 2024-04-26T18:00:40.088 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/.snap/snap-subdir-test 2024-04-26T18:00:40.113 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/30 file after the snapshot 2024-04-26T18:00:40.114 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/31 file after the snapshot 2024-04-26T18:00:40.115 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/32 file after the snapshot 2024-04-26T18:00:40.116 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/33 file after the snapshot 2024-04-26T18:00:40.119 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/34 file after the snapshot 2024-04-26T18:00:40.122 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/35 file after the snapshot 2024-04-26T18:00:40.125 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/36 file after the snapshot 2024-04-26T18:00:40.127 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/37 file after the snapshot 2024-04-26T18:00:40.131 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/38 file after the snapshot 2024-04-26T18:00:40.132 INFO:tasks.workunit.client.0.smithi012.stdout: create 114/39 file after the snapshot 2024-04-26T18:00:40.132 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/.snap/snap-subdir-test 2024-04-26T18:00:40.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/30 file after the snapshot 2024-04-26T18:00:40.150 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/31 file after the snapshot 2024-04-26T18:00:40.151 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/32 file after the snapshot 2024-04-26T18:00:40.153 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/33 file after the snapshot 2024-04-26T18:00:40.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/34 file after the snapshot 2024-04-26T18:00:40.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/35 file after the snapshot 2024-04-26T18:00:40.156 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/36 file after the snapshot 2024-04-26T18:00:40.158 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/37 file after the snapshot 2024-04-26T18:00:40.172 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/38 file after the snapshot 2024-04-26T18:00:40.173 INFO:tasks.workunit.client.0.smithi012.stdout: create 115/39 file after the snapshot 2024-04-26T18:00:40.174 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/.snap/snap-subdir-test 2024-04-26T18:00:40.193 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/30 file after the snapshot 2024-04-26T18:00:40.193 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/31 file after the snapshot 2024-04-26T18:00:40.194 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/32 file after the snapshot 2024-04-26T18:00:40.195 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/33 file after the snapshot 2024-04-26T18:00:40.196 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/34 file after the snapshot 2024-04-26T18:00:40.197 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/35 file after the snapshot 2024-04-26T18:00:40.198 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/36 file after the snapshot 2024-04-26T18:00:40.199 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/37 file after the snapshot 2024-04-26T18:00:40.200 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/38 file after the snapshot 2024-04-26T18:00:40.211 INFO:tasks.workunit.client.0.smithi012.stdout: create 116/39 file after the snapshot 2024-04-26T18:00:40.216 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/.snap/snap-subdir-test 2024-04-26T18:00:40.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/30 file after the snapshot 2024-04-26T18:00:40.236 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/31 file after the snapshot 2024-04-26T18:00:40.238 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/32 file after the snapshot 2024-04-26T18:00:40.240 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/33 file after the snapshot 2024-04-26T18:00:40.246 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/34 file after the snapshot 2024-04-26T18:00:40.249 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/35 file after the snapshot 2024-04-26T18:00:40.250 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/36 file after the snapshot 2024-04-26T18:00:40.253 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/37 file after the snapshot 2024-04-26T18:00:40.253 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/38 file after the snapshot 2024-04-26T18:00:40.254 INFO:tasks.workunit.client.0.smithi012.stdout: create 117/39 file after the snapshot 2024-04-26T18:00:40.255 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/.snap/snap-subdir-test 2024-04-26T18:00:40.274 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/30 file after the snapshot 2024-04-26T18:00:40.276 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/31 file after the snapshot 2024-04-26T18:00:40.280 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/32 file after the snapshot 2024-04-26T18:00:40.281 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/33 file after the snapshot 2024-04-26T18:00:40.282 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/34 file after the snapshot 2024-04-26T18:00:40.285 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/35 file after the snapshot 2024-04-26T18:00:40.287 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/36 file after the snapshot 2024-04-26T18:00:40.288 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/37 file after the snapshot 2024-04-26T18:00:40.289 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/38 file after the snapshot 2024-04-26T18:00:40.290 INFO:tasks.workunit.client.0.smithi012.stdout: create 118/39 file after the snapshot 2024-04-26T18:00:40.291 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/.snap/snap-subdir-test 2024-04-26T18:00:40.307 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/30 file after the snapshot 2024-04-26T18:00:40.308 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/31 file after the snapshot 2024-04-26T18:00:40.309 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/32 file after the snapshot 2024-04-26T18:00:40.312 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/33 file after the snapshot 2024-04-26T18:00:40.317 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/34 file after the snapshot 2024-04-26T18:00:40.322 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/35 file after the snapshot 2024-04-26T18:00:40.323 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/36 file after the snapshot 2024-04-26T18:00:40.324 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/37 file after the snapshot 2024-04-26T18:00:40.325 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/38 file after the snapshot 2024-04-26T18:00:40.326 INFO:tasks.workunit.client.0.smithi012.stdout: create 119/39 file after the snapshot 2024-04-26T18:00:40.326 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/.snap/snap-subdir-test 2024-04-26T18:00:40.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/30 file after the snapshot 2024-04-26T18:00:40.347 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/31 file after the snapshot 2024-04-26T18:00:40.349 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/32 file after the snapshot 2024-04-26T18:00:40.352 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/33 file after the snapshot 2024-04-26T18:00:40.355 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/34 file after the snapshot 2024-04-26T18:00:40.362 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/35 file after the snapshot 2024-04-26T18:00:40.362 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/36 file after the snapshot 2024-04-26T18:00:40.363 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/37 file after the snapshot 2024-04-26T18:00:40.364 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/38 file after the snapshot 2024-04-26T18:00:40.683 INFO:tasks.workunit.client.0.smithi012.stdout: create 120/39 file after the snapshot 2024-04-26T18:00:40.704 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/.snap/snap-subdir-test 2024-04-26T18:00:40.721 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/30 file after the snapshot 2024-04-26T18:00:40.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/31 file after the snapshot 2024-04-26T18:00:40.724 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/32 file after the snapshot 2024-04-26T18:00:40.728 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/33 file after the snapshot 2024-04-26T18:00:40.737 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/34 file after the snapshot 2024-04-26T18:00:40.738 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/35 file after the snapshot 2024-04-26T18:00:40.739 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/36 file after the snapshot 2024-04-26T18:00:40.740 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/37 file after the snapshot 2024-04-26T18:00:40.741 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/38 file after the snapshot 2024-04-26T18:00:40.742 INFO:tasks.workunit.client.0.smithi012.stdout: create 121/39 file after the snapshot 2024-04-26T18:00:40.743 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/.snap/snap-subdir-test 2024-04-26T18:00:40.758 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/30 file after the snapshot 2024-04-26T18:00:40.766 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/31 file after the snapshot 2024-04-26T18:00:40.768 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/32 file after the snapshot 2024-04-26T18:00:40.769 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/33 file after the snapshot 2024-04-26T18:00:40.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/34 file after the snapshot 2024-04-26T18:00:40.771 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/35 file after the snapshot 2024-04-26T18:00:40.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/36 file after the snapshot 2024-04-26T18:00:40.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/37 file after the snapshot 2024-04-26T18:00:40.779 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/38 file after the snapshot 2024-04-26T18:00:40.780 INFO:tasks.workunit.client.0.smithi012.stdout: create 122/39 file after the snapshot 2024-04-26T18:00:40.781 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/.snap/snap-subdir-test 2024-04-26T18:00:40.801 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/30 file after the snapshot 2024-04-26T18:00:40.802 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/31 file after the snapshot 2024-04-26T18:00:40.803 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/32 file after the snapshot 2024-04-26T18:00:40.804 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/33 file after the snapshot 2024-04-26T18:00:40.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/34 file after the snapshot 2024-04-26T18:00:40.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/35 file after the snapshot 2024-04-26T18:00:41.643 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/36 file after the snapshot 2024-04-26T18:00:41.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/37 file after the snapshot 2024-04-26T18:00:41.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/38 file after the snapshot 2024-04-26T18:00:41.774 INFO:tasks.workunit.client.0.smithi012.stdout: create 123/39 file after the snapshot 2024-04-26T18:00:41.775 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/.snap/snap-subdir-test 2024-04-26T18:00:41.794 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/30 file after the snapshot 2024-04-26T18:00:41.796 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/31 file after the snapshot 2024-04-26T18:00:41.797 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/32 file after the snapshot 2024-04-26T18:00:41.801 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/33 file after the snapshot 2024-04-26T18:00:41.806 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/34 file after the snapshot 2024-04-26T18:00:41.812 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/35 file after the snapshot 2024-04-26T18:00:41.813 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/36 file after the snapshot 2024-04-26T18:00:41.814 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/37 file after the snapshot 2024-04-26T18:00:41.815 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/38 file after the snapshot 2024-04-26T18:00:41.816 INFO:tasks.workunit.client.0.smithi012.stdout: create 124/39 file after the snapshot 2024-04-26T18:00:41.817 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/.snap/snap-subdir-test 2024-04-26T18:00:41.834 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/30 file after the snapshot 2024-04-26T18:00:41.835 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/31 file after the snapshot 2024-04-26T18:00:41.836 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/32 file after the snapshot 2024-04-26T18:00:41.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/33 file after the snapshot 2024-04-26T18:00:41.846 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/34 file after the snapshot 2024-04-26T18:00:42.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/35 file after the snapshot 2024-04-26T18:00:42.677 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/36 file after the snapshot 2024-04-26T18:00:42.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/37 file after the snapshot 2024-04-26T18:00:42.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/38 file after the snapshot 2024-04-26T18:00:42.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 125/39 file after the snapshot 2024-04-26T18:00:42.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/.snap/snap-subdir-test 2024-04-26T18:00:42.698 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/30 file after the snapshot 2024-04-26T18:00:42.700 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/31 file after the snapshot 2024-04-26T18:00:42.701 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/32 file after the snapshot 2024-04-26T18:00:42.706 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/33 file after the snapshot 2024-04-26T18:00:42.713 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/34 file after the snapshot 2024-04-26T18:00:42.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/35 file after the snapshot 2024-04-26T18:00:42.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/36 file after the snapshot 2024-04-26T18:00:42.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/37 file after the snapshot 2024-04-26T18:00:42.718 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/38 file after the snapshot 2024-04-26T18:00:42.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 126/39 file after the snapshot 2024-04-26T18:00:42.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/.snap/snap-subdir-test 2024-04-26T18:00:42.743 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/30 file after the snapshot 2024-04-26T18:00:42.744 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/31 file after the snapshot 2024-04-26T18:00:42.745 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/32 file after the snapshot 2024-04-26T18:00:42.747 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/33 file after the snapshot 2024-04-26T18:00:42.757 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/34 file after the snapshot 2024-04-26T18:00:42.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/35 file after the snapshot 2024-04-26T18:00:42.875 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/36 file after the snapshot 2024-04-26T18:00:42.876 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/37 file after the snapshot 2024-04-26T18:00:42.877 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/38 file after the snapshot 2024-04-26T18:00:42.879 INFO:tasks.workunit.client.0.smithi012.stdout: create 127/39 file after the snapshot 2024-04-26T18:00:42.880 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/.snap/snap-subdir-test 2024-04-26T18:00:43.629 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/30 file after the snapshot 2024-04-26T18:00:43.631 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/31 file after the snapshot 2024-04-26T18:00:43.633 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/32 file after the snapshot 2024-04-26T18:00:43.642 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/33 file after the snapshot 2024-04-26T18:00:43.646 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/34 file after the snapshot 2024-04-26T18:00:43.648 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/35 file after the snapshot 2024-04-26T18:00:43.648 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/36 file after the snapshot 2024-04-26T18:00:43.649 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/37 file after the snapshot 2024-04-26T18:00:43.650 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/38 file after the snapshot 2024-04-26T18:00:43.651 INFO:tasks.workunit.client.0.smithi012.stdout: create 128/39 file after the snapshot 2024-04-26T18:00:43.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/.snap/snap-subdir-test 2024-04-26T18:00:43.673 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/30 file after the snapshot 2024-04-26T18:00:43.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/31 file after the snapshot 2024-04-26T18:00:43.677 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/32 file after the snapshot 2024-04-26T18:00:43.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/33 file after the snapshot 2024-04-26T18:00:43.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/34 file after the snapshot 2024-04-26T18:00:43.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/35 file after the snapshot 2024-04-26T18:00:43.697 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/36 file after the snapshot 2024-04-26T18:00:43.698 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/37 file after the snapshot 2024-04-26T18:00:43.700 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/38 file after the snapshot 2024-04-26T18:00:43.701 INFO:tasks.workunit.client.0.smithi012.stdout: create 129/39 file after the snapshot 2024-04-26T18:00:43.702 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/.snap/snap-subdir-test 2024-04-26T18:00:43.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/30 file after the snapshot 2024-04-26T18:00:43.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/31 file after the snapshot 2024-04-26T18:00:43.721 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/32 file after the snapshot 2024-04-26T18:00:43.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/33 file after the snapshot 2024-04-26T18:00:43.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/34 file after the snapshot 2024-04-26T18:00:43.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/35 file after the snapshot 2024-04-26T18:00:43.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/36 file after the snapshot 2024-04-26T18:00:43.735 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/37 file after the snapshot 2024-04-26T18:00:43.737 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/38 file after the snapshot 2024-04-26T18:00:43.738 INFO:tasks.workunit.client.0.smithi012.stdout: create 130/39 file after the snapshot 2024-04-26T18:00:43.739 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/.snap/snap-subdir-test 2024-04-26T18:00:43.758 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/30 file after the snapshot 2024-04-26T18:00:43.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/31 file after the snapshot 2024-04-26T18:00:43.760 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/32 file after the snapshot 2024-04-26T18:00:43.761 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/33 file after the snapshot 2024-04-26T18:00:43.762 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/34 file after the snapshot 2024-04-26T18:00:43.765 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/35 file after the snapshot 2024-04-26T18:00:43.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/36 file after the snapshot 2024-04-26T18:00:43.777 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/37 file after the snapshot 2024-04-26T18:00:43.778 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/38 file after the snapshot 2024-04-26T18:00:43.779 INFO:tasks.workunit.client.0.smithi012.stdout: create 131/39 file after the snapshot 2024-04-26T18:00:43.780 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/.snap/snap-subdir-test 2024-04-26T18:00:43.795 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/30 file after the snapshot 2024-04-26T18:00:43.796 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/31 file after the snapshot 2024-04-26T18:00:43.799 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/32 file after the snapshot 2024-04-26T18:00:43.800 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/33 file after the snapshot 2024-04-26T18:00:43.803 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/34 file after the snapshot 2024-04-26T18:00:43.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/35 file after the snapshot 2024-04-26T18:00:44.018 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/36 file after the snapshot 2024-04-26T18:00:44.019 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/37 file after the snapshot 2024-04-26T18:00:44.020 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/38 file after the snapshot 2024-04-26T18:00:44.020 INFO:tasks.workunit.client.0.smithi012.stdout: create 132/39 file after the snapshot 2024-04-26T18:00:44.021 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/.snap/snap-subdir-test 2024-04-26T18:00:44.037 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/30 file after the snapshot 2024-04-26T18:00:44.042 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/31 file after the snapshot 2024-04-26T18:00:44.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:44.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:00:44.307 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/32 file after the snapshot 2024-04-26T18:00:44.315 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/33 file after the snapshot 2024-04-26T18:00:44.317 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/34 file after the snapshot 2024-04-26T18:00:44.318 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/35 file after the snapshot 2024-04-26T18:00:44.319 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/36 file after the snapshot 2024-04-26T18:00:44.320 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/37 file after the snapshot 2024-04-26T18:00:44.321 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/38 file after the snapshot 2024-04-26T18:00:44.322 INFO:tasks.workunit.client.0.smithi012.stdout: create 133/39 file after the snapshot 2024-04-26T18:00:44.323 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/.snap/snap-subdir-test 2024-04-26T18:00:44.343 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/30 file after the snapshot 2024-04-26T18:00:44.345 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/31 file after the snapshot 2024-04-26T18:00:44.347 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/32 file after the snapshot 2024-04-26T18:00:44.350 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/33 file after the snapshot 2024-04-26T18:00:44.357 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/34 file after the snapshot 2024-04-26T18:00:44.360 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/35 file after the snapshot 2024-04-26T18:00:44.361 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/36 file after the snapshot 2024-04-26T18:00:44.362 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/37 file after the snapshot 2024-04-26T18:00:44.363 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/38 file after the snapshot 2024-04-26T18:00:44.364 INFO:tasks.workunit.client.0.smithi012.stdout: create 134/39 file after the snapshot 2024-04-26T18:00:44.365 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/.snap/snap-subdir-test 2024-04-26T18:00:44.382 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/30 file after the snapshot 2024-04-26T18:00:44.384 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/31 file after the snapshot 2024-04-26T18:00:44.387 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/32 file after the snapshot 2024-04-26T18:00:44.389 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/33 file after the snapshot 2024-04-26T18:00:44.394 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/34 file after the snapshot 2024-04-26T18:00:44.398 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/35 file after the snapshot 2024-04-26T18:00:44.399 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/36 file after the snapshot 2024-04-26T18:00:44.400 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/37 file after the snapshot 2024-04-26T18:00:44.400 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/38 file after the snapshot 2024-04-26T18:00:44.401 INFO:tasks.workunit.client.0.smithi012.stdout: create 135/39 file after the snapshot 2024-04-26T18:00:44.402 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/.snap/snap-subdir-test 2024-04-26T18:00:44.418 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/30 file after the snapshot 2024-04-26T18:00:44.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/31 file after the snapshot 2024-04-26T18:00:44.421 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/32 file after the snapshot 2024-04-26T18:00:44.424 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/33 file after the snapshot 2024-04-26T18:00:44.427 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/34 file after the snapshot 2024-04-26T18:00:44.434 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/35 file after the snapshot 2024-04-26T18:00:44.435 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/36 file after the snapshot 2024-04-26T18:00:44.436 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/37 file after the snapshot 2024-04-26T18:00:44.437 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/38 file after the snapshot 2024-04-26T18:00:44.437 INFO:tasks.workunit.client.0.smithi012.stdout: create 136/39 file after the snapshot 2024-04-26T18:00:44.438 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/.snap/snap-subdir-test 2024-04-26T18:00:44.459 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/30 file after the snapshot 2024-04-26T18:00:44.467 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/31 file after the snapshot 2024-04-26T18:00:44.473 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/32 file after the snapshot 2024-04-26T18:00:44.474 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/33 file after the snapshot 2024-04-26T18:00:44.475 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/34 file after the snapshot 2024-04-26T18:00:44.476 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/35 file after the snapshot 2024-04-26T18:00:44.477 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/36 file after the snapshot 2024-04-26T18:00:44.478 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/37 file after the snapshot 2024-04-26T18:00:44.479 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/38 file after the snapshot 2024-04-26T18:00:44.480 INFO:tasks.workunit.client.0.smithi012.stdout: create 137/39 file after the snapshot 2024-04-26T18:00:44.481 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/.snap/snap-subdir-test 2024-04-26T18:00:44.498 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/30 file after the snapshot 2024-04-26T18:00:44.503 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/31 file after the snapshot 2024-04-26T18:00:44.508 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/32 file after the snapshot 2024-04-26T18:00:44.513 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/33 file after the snapshot 2024-04-26T18:00:44.515 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/34 file after the snapshot 2024-04-26T18:00:44.515 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/35 file after the snapshot 2024-04-26T18:00:44.516 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/36 file after the snapshot 2024-04-26T18:00:44.517 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/37 file after the snapshot 2024-04-26T18:00:44.518 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/38 file after the snapshot 2024-04-26T18:00:44.519 INFO:tasks.workunit.client.0.smithi012.stdout: create 138/39 file after the snapshot 2024-04-26T18:00:44.520 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/.snap/snap-subdir-test 2024-04-26T18:00:45.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/30 file after the snapshot 2024-04-26T18:00:45.266 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/31 file after the snapshot 2024-04-26T18:00:45.267 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/32 file after the snapshot 2024-04-26T18:00:45.273 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/33 file after the snapshot 2024-04-26T18:00:45.280 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/34 file after the snapshot 2024-04-26T18:00:45.282 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/35 file after the snapshot 2024-04-26T18:00:45.284 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/36 file after the snapshot 2024-04-26T18:00:45.284 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/37 file after the snapshot 2024-04-26T18:00:45.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/38 file after the snapshot 2024-04-26T18:00:45.287 INFO:tasks.workunit.client.0.smithi012.stdout: create 139/39 file after the snapshot 2024-04-26T18:00:45.288 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/.snap/snap-subdir-test 2024-04-26T18:00:45.306 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/30 file after the snapshot 2024-04-26T18:00:45.307 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/31 file after the snapshot 2024-04-26T18:00:45.308 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/32 file after the snapshot 2024-04-26T18:00:45.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/33 file after the snapshot 2024-04-26T18:00:45.315 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/34 file after the snapshot 2024-04-26T18:00:45.321 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/35 file after the snapshot 2024-04-26T18:00:45.325 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/36 file after the snapshot 2024-04-26T18:00:45.326 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/37 file after the snapshot 2024-04-26T18:00:45.327 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/38 file after the snapshot 2024-04-26T18:00:45.328 INFO:tasks.workunit.client.0.smithi012.stdout: create 140/39 file after the snapshot 2024-04-26T18:00:45.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/.snap/snap-subdir-test 2024-04-26T18:00:45.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/30 file after the snapshot 2024-04-26T18:00:45.353 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/31 file after the snapshot 2024-04-26T18:00:45.356 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/32 file after the snapshot 2024-04-26T18:00:45.356 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/33 file after the snapshot 2024-04-26T18:00:45.360 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/34 file after the snapshot 2024-04-26T18:00:45.369 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/35 file after the snapshot 2024-04-26T18:00:45.371 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/36 file after the snapshot 2024-04-26T18:00:45.372 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/37 file after the snapshot 2024-04-26T18:00:45.374 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/38 file after the snapshot 2024-04-26T18:00:45.375 INFO:tasks.workunit.client.0.smithi012.stdout: create 141/39 file after the snapshot 2024-04-26T18:00:45.376 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/.snap/snap-subdir-test 2024-04-26T18:00:45.393 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/30 file after the snapshot 2024-04-26T18:00:45.395 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/31 file after the snapshot 2024-04-26T18:00:45.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/32 file after the snapshot 2024-04-26T18:00:45.399 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/33 file after the snapshot 2024-04-26T18:00:45.399 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/34 file after the snapshot 2024-04-26T18:00:45.401 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/35 file after the snapshot 2024-04-26T18:00:45.405 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/36 file after the snapshot 2024-04-26T18:00:45.675 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/37 file after the snapshot 2024-04-26T18:00:46.125 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/38 file after the snapshot 2024-04-26T18:00:46.127 INFO:tasks.workunit.client.0.smithi012.stdout: create 142/39 file after the snapshot 2024-04-26T18:00:46.128 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/.snap/snap-subdir-test 2024-04-26T18:00:46.145 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/30 file after the snapshot 2024-04-26T18:00:46.147 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/31 file after the snapshot 2024-04-26T18:00:46.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/32 file after the snapshot 2024-04-26T18:00:46.149 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/33 file after the snapshot 2024-04-26T18:00:46.150 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/34 file after the snapshot 2024-04-26T18:00:46.151 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/35 file after the snapshot 2024-04-26T18:00:46.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/36 file after the snapshot 2024-04-26T18:00:46.163 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/37 file after the snapshot 2024-04-26T18:00:46.603 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/38 file after the snapshot 2024-04-26T18:00:46.604 INFO:tasks.workunit.client.0.smithi012.stdout: create 143/39 file after the snapshot 2024-04-26T18:00:46.605 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/.snap/snap-subdir-test 2024-04-26T18:00:46.625 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/30 file after the snapshot 2024-04-26T18:00:46.626 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/31 file after the snapshot 2024-04-26T18:00:46.627 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/32 file after the snapshot 2024-04-26T18:00:46.628 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/33 file after the snapshot 2024-04-26T18:00:46.630 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/34 file after the snapshot 2024-04-26T18:00:46.633 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/35 file after the snapshot 2024-04-26T18:00:46.642 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/36 file after the snapshot 2024-04-26T18:00:46.648 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/37 file after the snapshot 2024-04-26T18:00:46.649 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/38 file after the snapshot 2024-04-26T18:00:46.650 INFO:tasks.workunit.client.0.smithi012.stdout: create 144/39 file after the snapshot 2024-04-26T18:00:46.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/.snap/snap-subdir-test 2024-04-26T18:00:46.670 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/30 file after the snapshot 2024-04-26T18:00:46.673 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/31 file after the snapshot 2024-04-26T18:00:46.674 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/32 file after the snapshot 2024-04-26T18:00:46.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/33 file after the snapshot 2024-04-26T18:00:46.681 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/34 file after the snapshot 2024-04-26T18:00:46.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/35 file after the snapshot 2024-04-26T18:00:46.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/36 file after the snapshot 2024-04-26T18:00:46.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/37 file after the snapshot 2024-04-26T18:00:46.691 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/38 file after the snapshot 2024-04-26T18:00:46.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 145/39 file after the snapshot 2024-04-26T18:00:46.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/.snap/snap-subdir-test 2024-04-26T18:00:46.715 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/30 file after the snapshot 2024-04-26T18:00:46.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/31 file after the snapshot 2024-04-26T18:00:46.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/32 file after the snapshot 2024-04-26T18:00:46.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/33 file after the snapshot 2024-04-26T18:00:46.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/34 file after the snapshot 2024-04-26T18:00:47.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/35 file after the snapshot 2024-04-26T18:00:47.705 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/36 file after the snapshot 2024-04-26T18:00:47.706 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/37 file after the snapshot 2024-04-26T18:00:47.707 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/38 file after the snapshot 2024-04-26T18:00:47.708 INFO:tasks.workunit.client.0.smithi012.stdout: create 146/39 file after the snapshot 2024-04-26T18:00:47.709 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/.snap/snap-subdir-test 2024-04-26T18:00:47.729 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/30 file after the snapshot 2024-04-26T18:00:47.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/31 file after the snapshot 2024-04-26T18:00:47.733 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/32 file after the snapshot 2024-04-26T18:00:47.988 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/33 file after the snapshot 2024-04-26T18:00:47.997 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/34 file after the snapshot 2024-04-26T18:00:47.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/35 file after the snapshot 2024-04-26T18:00:47.999 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/36 file after the snapshot 2024-04-26T18:00:48.000 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/37 file after the snapshot 2024-04-26T18:00:48.001 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/38 file after the snapshot 2024-04-26T18:00:48.002 INFO:tasks.workunit.client.0.smithi012.stdout: create 147/39 file after the snapshot 2024-04-26T18:00:48.003 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/.snap/snap-subdir-test 2024-04-26T18:00:48.023 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/30 file after the snapshot 2024-04-26T18:00:48.025 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/31 file after the snapshot 2024-04-26T18:00:48.026 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/32 file after the snapshot 2024-04-26T18:00:48.027 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/33 file after the snapshot 2024-04-26T18:00:48.029 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/34 file after the snapshot 2024-04-26T18:00:48.034 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/35 file after the snapshot 2024-04-26T18:00:48.042 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/36 file after the snapshot 2024-04-26T18:00:48.043 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/37 file after the snapshot 2024-04-26T18:00:48.044 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/38 file after the snapshot 2024-04-26T18:00:48.044 INFO:tasks.workunit.client.0.smithi012.stdout: create 148/39 file after the snapshot 2024-04-26T18:00:48.046 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/.snap/snap-subdir-test 2024-04-26T18:00:48.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/30 file after the snapshot 2024-04-26T18:00:48.076 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/31 file after the snapshot 2024-04-26T18:00:48.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/32 file after the snapshot 2024-04-26T18:00:48.089 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/33 file after the snapshot 2024-04-26T18:00:48.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/34 file after the snapshot 2024-04-26T18:00:48.093 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/35 file after the snapshot 2024-04-26T18:00:48.095 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/36 file after the snapshot 2024-04-26T18:00:48.097 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/37 file after the snapshot 2024-04-26T18:00:48.099 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/38 file after the snapshot 2024-04-26T18:00:48.101 INFO:tasks.workunit.client.0.smithi012.stdout: create 149/39 file after the snapshot 2024-04-26T18:00:48.104 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/.snap/snap-subdir-test 2024-04-26T18:00:48.152 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/30 file after the snapshot 2024-04-26T18:00:48.154 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/31 file after the snapshot 2024-04-26T18:00:48.156 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/32 file after the snapshot 2024-04-26T18:00:48.166 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/33 file after the snapshot 2024-04-26T18:00:48.167 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/34 file after the snapshot 2024-04-26T18:00:48.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/35 file after the snapshot 2024-04-26T18:00:48.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/36 file after the snapshot 2024-04-26T18:00:48.169 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/37 file after the snapshot 2024-04-26T18:00:48.170 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/38 file after the snapshot 2024-04-26T18:00:48.171 INFO:tasks.workunit.client.0.smithi012.stdout: create 150/39 file after the snapshot 2024-04-26T18:00:48.172 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/.snap/snap-subdir-test 2024-04-26T18:00:48.442 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/30 file after the snapshot 2024-04-26T18:00:48.444 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/31 file after the snapshot 2024-04-26T18:00:48.446 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/32 file after the snapshot 2024-04-26T18:00:48.454 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/33 file after the snapshot 2024-04-26T18:00:48.458 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/34 file after the snapshot 2024-04-26T18:00:48.459 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/35 file after the snapshot 2024-04-26T18:00:48.460 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/36 file after the snapshot 2024-04-26T18:00:48.460 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/37 file after the snapshot 2024-04-26T18:00:48.461 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/38 file after the snapshot 2024-04-26T18:00:48.462 INFO:tasks.workunit.client.0.smithi012.stdout: create 151/39 file after the snapshot 2024-04-26T18:00:48.463 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/.snap/snap-subdir-test 2024-04-26T18:00:48.480 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/30 file after the snapshot 2024-04-26T18:00:48.481 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/31 file after the snapshot 2024-04-26T18:00:48.484 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/32 file after the snapshot 2024-04-26T18:00:48.491 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/33 file after the snapshot 2024-04-26T18:00:48.572 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/34 file after the snapshot 2024-04-26T18:00:48.574 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/35 file after the snapshot 2024-04-26T18:00:48.576 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/36 file after the snapshot 2024-04-26T18:00:48.577 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/37 file after the snapshot 2024-04-26T18:00:48.578 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/38 file after the snapshot 2024-04-26T18:00:48.579 INFO:tasks.workunit.client.0.smithi012.stdout: create 152/39 file after the snapshot 2024-04-26T18:00:48.579 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/.snap/snap-subdir-test 2024-04-26T18:00:48.595 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/30 file after the snapshot 2024-04-26T18:00:48.597 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/31 file after the snapshot 2024-04-26T18:00:48.598 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/32 file after the snapshot 2024-04-26T18:00:48.600 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/33 file after the snapshot 2024-04-26T18:00:48.606 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/34 file after the snapshot 2024-04-26T18:00:48.611 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/35 file after the snapshot 2024-04-26T18:00:48.612 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/36 file after the snapshot 2024-04-26T18:00:48.612 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/37 file after the snapshot 2024-04-26T18:00:48.613 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/38 file after the snapshot 2024-04-26T18:00:48.614 INFO:tasks.workunit.client.0.smithi012.stdout: create 153/39 file after the snapshot 2024-04-26T18:00:48.615 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/.snap/snap-subdir-test 2024-04-26T18:00:48.634 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/30 file after the snapshot 2024-04-26T18:00:48.639 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/31 file after the snapshot 2024-04-26T18:00:48.651 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/32 file after the snapshot 2024-04-26T18:00:48.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/33 file after the snapshot 2024-04-26T18:00:48.653 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/34 file after the snapshot 2024-04-26T18:00:48.654 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/35 file after the snapshot 2024-04-26T18:00:48.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/36 file after the snapshot 2024-04-26T18:00:48.656 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/37 file after the snapshot 2024-04-26T18:00:48.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/38 file after the snapshot 2024-04-26T18:00:48.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 154/39 file after the snapshot 2024-04-26T18:00:48.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/.snap/snap-subdir-test 2024-04-26T18:00:48.675 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/30 file after the snapshot 2024-04-26T18:00:48.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/31 file after the snapshot 2024-04-26T18:00:48.677 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/32 file after the snapshot 2024-04-26T18:00:48.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/33 file after the snapshot 2024-04-26T18:00:48.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/34 file after the snapshot 2024-04-26T18:00:48.690 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/35 file after the snapshot 2024-04-26T18:00:49.327 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/36 file after the snapshot 2024-04-26T18:00:49.327 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/37 file after the snapshot 2024-04-26T18:00:49.328 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/38 file after the snapshot 2024-04-26T18:00:49.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 155/39 file after the snapshot 2024-04-26T18:00:49.331 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/.snap/snap-subdir-test 2024-04-26T18:00:49.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/30 file after the snapshot 2024-04-26T18:00:49.872 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/31 file after the snapshot 2024-04-26T18:00:49.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/32 file after the snapshot 2024-04-26T18:00:49.876 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/33 file after the snapshot 2024-04-26T18:00:49.881 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/34 file after the snapshot 2024-04-26T18:00:50.341 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/35 file after the snapshot 2024-04-26T18:00:50.342 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/36 file after the snapshot 2024-04-26T18:00:50.343 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/37 file after the snapshot 2024-04-26T18:00:50.344 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/38 file after the snapshot 2024-04-26T18:00:50.345 INFO:tasks.workunit.client.0.smithi012.stdout: create 156/39 file after the snapshot 2024-04-26T18:00:50.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/.snap/snap-subdir-test 2024-04-26T18:00:50.362 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/30 file after the snapshot 2024-04-26T18:00:50.364 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/31 file after the snapshot 2024-04-26T18:00:50.367 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/32 file after the snapshot 2024-04-26T18:00:50.378 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/33 file after the snapshot 2024-04-26T18:00:50.667 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/34 file after the snapshot 2024-04-26T18:00:51.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/35 file after the snapshot 2024-04-26T18:00:51.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/36 file after the snapshot 2024-04-26T18:00:51.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/37 file after the snapshot 2024-04-26T18:00:51.074 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/38 file after the snapshot 2024-04-26T18:00:51.075 INFO:tasks.workunit.client.0.smithi012.stdout: create 157/39 file after the snapshot 2024-04-26T18:00:51.076 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/.snap/snap-subdir-test 2024-04-26T18:00:51.097 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/30 file after the snapshot 2024-04-26T18:00:51.099 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/31 file after the snapshot 2024-04-26T18:00:51.100 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/32 file after the snapshot 2024-04-26T18:00:51.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/33 file after the snapshot 2024-04-26T18:00:51.111 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/34 file after the snapshot 2024-04-26T18:00:51.115 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/35 file after the snapshot 2024-04-26T18:00:51.116 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/36 file after the snapshot 2024-04-26T18:00:51.117 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/37 file after the snapshot 2024-04-26T18:00:51.117 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/38 file after the snapshot 2024-04-26T18:00:51.118 INFO:tasks.workunit.client.0.smithi012.stdout: create 158/39 file after the snapshot 2024-04-26T18:00:51.119 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/.snap/snap-subdir-test 2024-04-26T18:00:51.137 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/30 file after the snapshot 2024-04-26T18:00:51.139 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/31 file after the snapshot 2024-04-26T18:00:51.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/32 file after the snapshot 2024-04-26T18:00:51.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/33 file after the snapshot 2024-04-26T18:00:51.153 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/34 file after the snapshot 2024-04-26T18:00:51.154 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/35 file after the snapshot 2024-04-26T18:00:51.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/36 file after the snapshot 2024-04-26T18:00:51.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/37 file after the snapshot 2024-04-26T18:00:51.156 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/38 file after the snapshot 2024-04-26T18:00:51.157 INFO:tasks.workunit.client.0.smithi012.stdout: create 159/39 file after the snapshot 2024-04-26T18:00:51.158 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/.snap/snap-subdir-test 2024-04-26T18:00:51.629 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/30 file after the snapshot 2024-04-26T18:00:51.637 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/31 file after the snapshot 2024-04-26T18:00:51.647 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/32 file after the snapshot 2024-04-26T18:00:51.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/33 file after the snapshot 2024-04-26T18:00:51.653 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/34 file after the snapshot 2024-04-26T18:00:51.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/35 file after the snapshot 2024-04-26T18:00:51.656 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/36 file after the snapshot 2024-04-26T18:00:51.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/37 file after the snapshot 2024-04-26T18:00:51.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/38 file after the snapshot 2024-04-26T18:00:51.661 INFO:tasks.workunit.client.0.smithi012.stdout: create 160/39 file after the snapshot 2024-04-26T18:00:51.662 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/.snap/snap-subdir-test 2024-04-26T18:00:51.913 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/30 file after the snapshot 2024-04-26T18:00:51.914 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/31 file after the snapshot 2024-04-26T18:00:51.916 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/32 file after the snapshot 2024-04-26T18:00:51.922 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/33 file after the snapshot 2024-04-26T18:00:51.930 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/34 file after the snapshot 2024-04-26T18:00:51.931 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/35 file after the snapshot 2024-04-26T18:00:51.932 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/36 file after the snapshot 2024-04-26T18:00:51.933 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/37 file after the snapshot 2024-04-26T18:00:51.934 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/38 file after the snapshot 2024-04-26T18:00:51.935 INFO:tasks.workunit.client.0.smithi012.stdout: create 161/39 file after the snapshot 2024-04-26T18:00:51.936 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/.snap/snap-subdir-test 2024-04-26T18:00:51.962 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/30 file after the snapshot 2024-04-26T18:00:51.964 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/31 file after the snapshot 2024-04-26T18:00:51.965 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/32 file after the snapshot 2024-04-26T18:00:51.965 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/33 file after the snapshot 2024-04-26T18:00:51.966 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/34 file after the snapshot 2024-04-26T18:00:51.967 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/35 file after the snapshot 2024-04-26T18:00:51.972 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/36 file after the snapshot 2024-04-26T18:00:52.651 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/37 file after the snapshot 2024-04-26T18:00:52.694 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/38 file after the snapshot 2024-04-26T18:00:52.695 INFO:tasks.workunit.client.0.smithi012.stdout: create 162/39 file after the snapshot 2024-04-26T18:00:52.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/.snap/snap-subdir-test 2024-04-26T18:00:53.180 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/30 file after the snapshot 2024-04-26T18:00:53.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/31 file after the snapshot 2024-04-26T18:00:53.443 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/32 file after the snapshot 2024-04-26T18:00:53.476 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/33 file after the snapshot 2024-04-26T18:00:53.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/34 file after the snapshot 2024-04-26T18:00:53.653 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/35 file after the snapshot 2024-04-26T18:00:53.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/36 file after the snapshot 2024-04-26T18:00:53.656 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/37 file after the snapshot 2024-04-26T18:00:53.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/38 file after the snapshot 2024-04-26T18:00:53.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 163/39 file after the snapshot 2024-04-26T18:00:53.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/.snap/snap-subdir-test 2024-04-26T18:00:53.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/30 file after the snapshot 2024-04-26T18:00:53.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/31 file after the snapshot 2024-04-26T18:00:53.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/32 file after the snapshot 2024-04-26T18:00:53.690 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/33 file after the snapshot 2024-04-26T18:00:53.690 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/34 file after the snapshot 2024-04-26T18:00:53.691 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/35 file after the snapshot 2024-04-26T18:00:53.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/36 file after the snapshot 2024-04-26T18:00:53.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/37 file after the snapshot 2024-04-26T18:00:53.694 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/38 file after the snapshot 2024-04-26T18:00:53.695 INFO:tasks.workunit.client.0.smithi012.stdout: create 164/39 file after the snapshot 2024-04-26T18:00:53.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/.snap/snap-subdir-test 2024-04-26T18:00:53.709 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/30 file after the snapshot 2024-04-26T18:00:53.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/31 file after the snapshot 2024-04-26T18:00:53.711 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/32 file after the snapshot 2024-04-26T18:00:53.712 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/33 file after the snapshot 2024-04-26T18:00:53.713 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/34 file after the snapshot 2024-04-26T18:00:53.713 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/35 file after the snapshot 2024-04-26T18:00:53.714 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/36 file after the snapshot 2024-04-26T18:00:53.715 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/37 file after the snapshot 2024-04-26T18:00:53.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/38 file after the snapshot 2024-04-26T18:00:53.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 165/39 file after the snapshot 2024-04-26T18:00:53.718 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/.snap/snap-subdir-test 2024-04-26T18:00:54.661 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/30 file after the snapshot 2024-04-26T18:00:54.662 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/31 file after the snapshot 2024-04-26T18:00:54.663 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/32 file after the snapshot 2024-04-26T18:00:54.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/33 file after the snapshot 2024-04-26T18:00:54.665 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/34 file after the snapshot 2024-04-26T18:00:54.666 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/35 file after the snapshot 2024-04-26T18:00:54.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/36 file after the snapshot 2024-04-26T18:00:54.675 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/37 file after the snapshot 2024-04-26T18:00:54.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/38 file after the snapshot 2024-04-26T18:00:54.677 INFO:tasks.workunit.client.0.smithi012.stdout: create 166/39 file after the snapshot 2024-04-26T18:00:54.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/.snap/snap-subdir-test 2024-04-26T18:00:54.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/30 file after the snapshot 2024-04-26T18:00:54.690 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/31 file after the snapshot 2024-04-26T18:00:54.691 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/32 file after the snapshot 2024-04-26T18:00:54.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/33 file after the snapshot 2024-04-26T18:00:54.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/34 file after the snapshot 2024-04-26T18:00:54.694 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/35 file after the snapshot 2024-04-26T18:00:54.694 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/36 file after the snapshot 2024-04-26T18:00:54.695 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/37 file after the snapshot 2024-04-26T18:00:54.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/38 file after the snapshot 2024-04-26T18:00:54.697 INFO:tasks.workunit.client.0.smithi012.stdout: create 167/39 file after the snapshot 2024-04-26T18:00:54.698 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/.snap/snap-subdir-test 2024-04-26T18:00:54.709 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/30 file after the snapshot 2024-04-26T18:00:54.715 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/31 file after the snapshot 2024-04-26T18:00:54.724 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/32 file after the snapshot 2024-04-26T18:00:54.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/33 file after the snapshot 2024-04-26T18:00:54.727 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/34 file after the snapshot 2024-04-26T18:00:54.728 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/35 file after the snapshot 2024-04-26T18:00:54.729 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/36 file after the snapshot 2024-04-26T18:00:54.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/37 file after the snapshot 2024-04-26T18:00:54.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/38 file after the snapshot 2024-04-26T18:00:54.733 INFO:tasks.workunit.client.0.smithi012.stdout: create 168/39 file after the snapshot 2024-04-26T18:00:54.735 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/.snap/snap-subdir-test 2024-04-26T18:00:54.747 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/30 file after the snapshot 2024-04-26T18:00:54.752 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/31 file after the snapshot 2024-04-26T18:00:54.758 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/32 file after the snapshot 2024-04-26T18:00:54.763 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/33 file after the snapshot 2024-04-26T18:00:54.765 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/34 file after the snapshot 2024-04-26T18:00:54.766 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/35 file after the snapshot 2024-04-26T18:00:54.767 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/36 file after the snapshot 2024-04-26T18:00:54.767 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/37 file after the snapshot 2024-04-26T18:00:54.768 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/38 file after the snapshot 2024-04-26T18:00:54.769 INFO:tasks.workunit.client.0.smithi012.stdout: create 169/39 file after the snapshot 2024-04-26T18:00:54.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/.snap/snap-subdir-test 2024-04-26T18:00:54.787 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/30 file after the snapshot 2024-04-26T18:00:54.792 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/31 file after the snapshot 2024-04-26T18:00:54.804 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/32 file after the snapshot 2024-04-26T18:00:54.806 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/33 file after the snapshot 2024-04-26T18:00:54.807 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/34 file after the snapshot 2024-04-26T18:00:54.808 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/35 file after the snapshot 2024-04-26T18:00:54.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/36 file after the snapshot 2024-04-26T18:00:54.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/37 file after the snapshot 2024-04-26T18:00:54.810 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/38 file after the snapshot 2024-04-26T18:00:54.811 INFO:tasks.workunit.client.0.smithi012.stdout: create 170/39 file after the snapshot 2024-04-26T18:00:54.812 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/.snap/snap-subdir-test 2024-04-26T18:00:54.827 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/30 file after the snapshot 2024-04-26T18:00:54.830 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/31 file after the snapshot 2024-04-26T18:00:54.831 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/32 file after the snapshot 2024-04-26T18:00:54.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/33 file after the snapshot 2024-04-26T18:00:54.841 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/34 file after the snapshot 2024-04-26T18:00:54.842 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/35 file after the snapshot 2024-04-26T18:00:54.844 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/36 file after the snapshot 2024-04-26T18:00:54.845 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/37 file after the snapshot 2024-04-26T18:00:54.846 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/38 file after the snapshot 2024-04-26T18:00:54.847 INFO:tasks.workunit.client.0.smithi012.stdout: create 171/39 file after the snapshot 2024-04-26T18:00:54.848 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/.snap/snap-subdir-test 2024-04-26T18:00:54.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/30 file after the snapshot 2024-04-26T18:00:54.871 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/31 file after the snapshot 2024-04-26T18:00:54.872 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/32 file after the snapshot 2024-04-26T18:00:54.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/33 file after the snapshot 2024-04-26T18:00:54.880 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/34 file after the snapshot 2024-04-26T18:00:54.885 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/35 file after the snapshot 2024-04-26T18:00:54.886 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/36 file after the snapshot 2024-04-26T18:00:54.887 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/37 file after the snapshot 2024-04-26T18:00:54.888 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/38 file after the snapshot 2024-04-26T18:00:54.889 INFO:tasks.workunit.client.0.smithi012.stdout: create 172/39 file after the snapshot 2024-04-26T18:00:54.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/.snap/snap-subdir-test 2024-04-26T18:00:54.905 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/30 file after the snapshot 2024-04-26T18:00:54.907 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/31 file after the snapshot 2024-04-26T18:00:54.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/32 file after the snapshot 2024-04-26T18:00:54.911 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/33 file after the snapshot 2024-04-26T18:00:54.913 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/34 file after the snapshot 2024-04-26T18:00:54.914 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/35 file after the snapshot 2024-04-26T18:00:54.915 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/36 file after the snapshot 2024-04-26T18:00:54.919 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/37 file after the snapshot 2024-04-26T18:00:55.223 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/38 file after the snapshot 2024-04-26T18:00:55.224 INFO:tasks.workunit.client.0.smithi012.stdout: create 173/39 file after the snapshot 2024-04-26T18:00:55.225 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/.snap/snap-subdir-test 2024-04-26T18:00:55.243 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/30 file after the snapshot 2024-04-26T18:00:55.244 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/31 file after the snapshot 2024-04-26T18:00:55.246 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/32 file after the snapshot 2024-04-26T18:00:55.249 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/33 file after the snapshot 2024-04-26T18:00:55.254 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/34 file after the snapshot 2024-04-26T18:00:55.260 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/35 file after the snapshot 2024-04-26T18:00:55.260 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/36 file after the snapshot 2024-04-26T18:00:55.261 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/37 file after the snapshot 2024-04-26T18:00:55.262 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/38 file after the snapshot 2024-04-26T18:00:55.263 INFO:tasks.workunit.client.0.smithi012.stdout: create 174/39 file after the snapshot 2024-04-26T18:00:55.264 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/.snap/snap-subdir-test 2024-04-26T18:00:55.280 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/30 file after the snapshot 2024-04-26T18:00:55.283 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/31 file after the snapshot 2024-04-26T18:00:55.283 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/32 file after the snapshot 2024-04-26T18:00:55.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/33 file after the snapshot 2024-04-26T18:00:55.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/34 file after the snapshot 2024-04-26T18:00:55.290 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/35 file after the snapshot 2024-04-26T18:00:55.298 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/36 file after the snapshot 2024-04-26T18:00:55.299 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/37 file after the snapshot 2024-04-26T18:00:55.300 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/38 file after the snapshot 2024-04-26T18:00:55.301 INFO:tasks.workunit.client.0.smithi012.stdout: create 175/39 file after the snapshot 2024-04-26T18:00:55.303 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/.snap/snap-subdir-test 2024-04-26T18:00:55.565 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/30 file after the snapshot 2024-04-26T18:00:55.566 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/31 file after the snapshot 2024-04-26T18:00:55.568 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/32 file after the snapshot 2024-04-26T18:00:55.572 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/33 file after the snapshot 2024-04-26T18:00:55.577 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/34 file after the snapshot 2024-04-26T18:00:55.580 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/35 file after the snapshot 2024-04-26T18:00:55.581 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/36 file after the snapshot 2024-04-26T18:00:55.582 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/37 file after the snapshot 2024-04-26T18:00:55.583 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/38 file after the snapshot 2024-04-26T18:00:55.584 INFO:tasks.workunit.client.0.smithi012.stdout: create 176/39 file after the snapshot 2024-04-26T18:00:55.585 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/.snap/snap-subdir-test 2024-04-26T18:00:55.602 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/30 file after the snapshot 2024-04-26T18:00:55.604 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/31 file after the snapshot 2024-04-26T18:00:55.606 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/32 file after the snapshot 2024-04-26T18:00:55.609 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/33 file after the snapshot 2024-04-26T18:00:55.615 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/34 file after the snapshot 2024-04-26T18:00:55.617 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/35 file after the snapshot 2024-04-26T18:00:55.618 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/36 file after the snapshot 2024-04-26T18:00:55.619 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/37 file after the snapshot 2024-04-26T18:00:55.620 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/38 file after the snapshot 2024-04-26T18:00:55.621 INFO:tasks.workunit.client.0.smithi012.stdout: create 177/39 file after the snapshot 2024-04-26T18:00:55.622 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/.snap/snap-subdir-test 2024-04-26T18:00:55.638 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/30 file after the snapshot 2024-04-26T18:00:55.640 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/31 file after the snapshot 2024-04-26T18:00:55.641 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/32 file after the snapshot 2024-04-26T18:00:55.643 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/33 file after the snapshot 2024-04-26T18:00:55.645 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/34 file after the snapshot 2024-04-26T18:00:55.645 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/35 file after the snapshot 2024-04-26T18:00:55.646 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/36 file after the snapshot 2024-04-26T18:00:55.649 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/37 file after the snapshot 2024-04-26T18:00:55.653 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/38 file after the snapshot 2024-04-26T18:00:55.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 178/39 file after the snapshot 2024-04-26T18:00:55.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/.snap/snap-subdir-test 2024-04-26T18:00:55.674 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/30 file after the snapshot 2024-04-26T18:00:55.675 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/31 file after the snapshot 2024-04-26T18:00:55.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/32 file after the snapshot 2024-04-26T18:00:55.677 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/33 file after the snapshot 2024-04-26T18:00:55.681 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/34 file after the snapshot 2024-04-26T18:00:55.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/35 file after the snapshot 2024-04-26T18:00:55.690 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/36 file after the snapshot 2024-04-26T18:00:55.691 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/37 file after the snapshot 2024-04-26T18:00:55.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/38 file after the snapshot 2024-04-26T18:00:55.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 179/39 file after the snapshot 2024-04-26T18:00:55.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/.snap/snap-subdir-test 2024-04-26T18:00:55.714 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/30 file after the snapshot 2024-04-26T18:00:55.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/31 file after the snapshot 2024-04-26T18:00:55.718 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/32 file after the snapshot 2024-04-26T18:00:55.722 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/33 file after the snapshot 2024-04-26T18:00:55.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/34 file after the snapshot 2024-04-26T18:00:55.731 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/35 file after the snapshot 2024-04-26T18:00:55.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/36 file after the snapshot 2024-04-26T18:00:55.733 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/37 file after the snapshot 2024-04-26T18:00:55.734 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/38 file after the snapshot 2024-04-26T18:00:55.735 INFO:tasks.workunit.client.0.smithi012.stdout: create 180/39 file after the snapshot 2024-04-26T18:00:55.736 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/.snap/snap-subdir-test 2024-04-26T18:00:55.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/30 file after the snapshot 2024-04-26T18:00:55.754 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/31 file after the snapshot 2024-04-26T18:00:55.755 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/32 file after the snapshot 2024-04-26T18:00:55.756 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/33 file after the snapshot 2024-04-26T18:00:55.758 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/34 file after the snapshot 2024-04-26T18:00:55.764 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/35 file after the snapshot 2024-04-26T18:00:55.769 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/36 file after the snapshot 2024-04-26T18:00:55.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/37 file after the snapshot 2024-04-26T18:00:55.771 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/38 file after the snapshot 2024-04-26T18:00:55.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 181/39 file after the snapshot 2024-04-26T18:00:55.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/.snap/snap-subdir-test 2024-04-26T18:00:55.791 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/30 file after the snapshot 2024-04-26T18:00:55.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/31 file after the snapshot 2024-04-26T18:00:55.794 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/32 file after the snapshot 2024-04-26T18:00:55.796 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/33 file after the snapshot 2024-04-26T18:00:55.797 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/34 file after the snapshot 2024-04-26T18:00:55.799 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/35 file after the snapshot 2024-04-26T18:00:55.804 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/36 file after the snapshot 2024-04-26T18:00:55.808 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/37 file after the snapshot 2024-04-26T18:00:55.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/38 file after the snapshot 2024-04-26T18:00:55.811 INFO:tasks.workunit.client.0.smithi012.stdout: create 182/39 file after the snapshot 2024-04-26T18:00:55.811 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/.snap/snap-subdir-test 2024-04-26T18:00:56.780 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/30 file after the snapshot 2024-04-26T18:00:56.780 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/31 file after the snapshot 2024-04-26T18:00:56.782 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/32 file after the snapshot 2024-04-26T18:00:56.786 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/33 file after the snapshot 2024-04-26T18:00:56.787 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/34 file after the snapshot 2024-04-26T18:00:56.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/35 file after the snapshot 2024-04-26T18:00:56.802 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/36 file after the snapshot 2024-04-26T18:00:56.804 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/37 file after the snapshot 2024-04-26T18:00:56.806 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/38 file after the snapshot 2024-04-26T18:00:56.807 INFO:tasks.workunit.client.0.smithi012.stdout: create 183/39 file after the snapshot 2024-04-26T18:00:56.809 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/.snap/snap-subdir-test 2024-04-26T18:00:56.830 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/30 file after the snapshot 2024-04-26T18:00:56.832 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/31 file after the snapshot 2024-04-26T18:00:56.835 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/32 file after the snapshot 2024-04-26T18:00:56.843 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/33 file after the snapshot 2024-04-26T18:00:56.846 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/34 file after the snapshot 2024-04-26T18:00:56.847 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/35 file after the snapshot 2024-04-26T18:00:56.848 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/36 file after the snapshot 2024-04-26T18:00:56.849 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/37 file after the snapshot 2024-04-26T18:00:56.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/38 file after the snapshot 2024-04-26T18:00:56.851 INFO:tasks.workunit.client.0.smithi012.stdout: create 184/39 file after the snapshot 2024-04-26T18:00:56.852 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/.snap/snap-subdir-test 2024-04-26T18:00:56.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/30 file after the snapshot 2024-04-26T18:00:56.872 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/31 file after the snapshot 2024-04-26T18:00:56.875 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/32 file after the snapshot 2024-04-26T18:00:56.879 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/33 file after the snapshot 2024-04-26T18:00:57.220 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/34 file after the snapshot 2024-04-26T18:00:57.220 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/35 file after the snapshot 2024-04-26T18:00:57.221 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/36 file after the snapshot 2024-04-26T18:00:57.222 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/37 file after the snapshot 2024-04-26T18:00:57.223 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/38 file after the snapshot 2024-04-26T18:00:57.225 INFO:tasks.workunit.client.0.smithi012.stdout: create 185/39 file after the snapshot 2024-04-26T18:00:57.226 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/.snap/snap-subdir-test 2024-04-26T18:00:57.243 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/30 file after the snapshot 2024-04-26T18:00:57.245 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/31 file after the snapshot 2024-04-26T18:00:57.247 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/32 file after the snapshot 2024-04-26T18:00:57.499 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/33 file after the snapshot 2024-04-26T18:00:57.507 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/34 file after the snapshot 2024-04-26T18:00:57.508 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/35 file after the snapshot 2024-04-26T18:00:57.643 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/36 file after the snapshot 2024-04-26T18:00:58.184 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/37 file after the snapshot 2024-04-26T18:00:58.185 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/38 file after the snapshot 2024-04-26T18:00:58.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 186/39 file after the snapshot 2024-04-26T18:00:58.187 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/.snap/snap-subdir-test 2024-04-26T18:00:58.209 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/30 file after the snapshot 2024-04-26T18:00:58.210 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/31 file after the snapshot 2024-04-26T18:00:58.213 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/32 file after the snapshot 2024-04-26T18:00:58.225 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/33 file after the snapshot 2024-04-26T18:00:58.229 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/34 file after the snapshot 2024-04-26T18:00:58.230 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/35 file after the snapshot 2024-04-26T18:00:58.231 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/36 file after the snapshot 2024-04-26T18:00:58.233 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/37 file after the snapshot 2024-04-26T18:00:58.234 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/38 file after the snapshot 2024-04-26T18:00:58.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 187/39 file after the snapshot 2024-04-26T18:00:58.237 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/.snap/snap-subdir-test 2024-04-26T18:00:58.258 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/30 file after the snapshot 2024-04-26T18:00:58.258 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/31 file after the snapshot 2024-04-26T18:00:58.259 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/32 file after the snapshot 2024-04-26T18:00:58.269 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/33 file after the snapshot 2024-04-26T18:00:58.272 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/34 file after the snapshot 2024-04-26T18:00:58.273 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/35 file after the snapshot 2024-04-26T18:00:58.274 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/36 file after the snapshot 2024-04-26T18:00:58.275 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/37 file after the snapshot 2024-04-26T18:00:58.276 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/38 file after the snapshot 2024-04-26T18:00:58.277 INFO:tasks.workunit.client.0.smithi012.stdout: create 188/39 file after the snapshot 2024-04-26T18:00:58.278 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/.snap/snap-subdir-test 2024-04-26T18:00:58.613 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/30 file after the snapshot 2024-04-26T18:00:59.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/31 file after the snapshot 2024-04-26T18:00:59.627 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/32 file after the snapshot 2024-04-26T18:00:59.628 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/33 file after the snapshot 2024-04-26T18:00:59.629 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/34 file after the snapshot 2024-04-26T18:00:59.631 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/35 file after the snapshot 2024-04-26T18:00:59.632 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/36 file after the snapshot 2024-04-26T18:00:59.633 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/37 file after the snapshot 2024-04-26T18:00:59.635 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/38 file after the snapshot 2024-04-26T18:00:59.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 189/39 file after the snapshot 2024-04-26T18:00:59.638 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/.snap/snap-subdir-test 2024-04-26T18:00:59.649 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/30 file after the snapshot 2024-04-26T18:00:59.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/31 file after the snapshot 2024-04-26T18:00:59.652 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/32 file after the snapshot 2024-04-26T18:00:59.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/33 file after the snapshot 2024-04-26T18:00:59.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/34 file after the snapshot 2024-04-26T18:00:59.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/35 file after the snapshot 2024-04-26T18:00:59.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/36 file after the snapshot 2024-04-26T18:00:59.658 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/37 file after the snapshot 2024-04-26T18:00:59.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/38 file after the snapshot 2024-04-26T18:00:59.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 190/39 file after the snapshot 2024-04-26T18:00:59.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/.snap/snap-subdir-test 2024-04-26T18:00:59.674 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/30 file after the snapshot 2024-04-26T18:00:59.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/31 file after the snapshot 2024-04-26T18:00:59.676 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/32 file after the snapshot 2024-04-26T18:00:59.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/33 file after the snapshot 2024-04-26T18:00:59.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/34 file after the snapshot 2024-04-26T18:00:59.680 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/35 file after the snapshot 2024-04-26T18:00:59.682 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/36 file after the snapshot 2024-04-26T18:00:59.683 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/37 file after the snapshot 2024-04-26T18:00:59.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/38 file after the snapshot 2024-04-26T18:00:59.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 191/39 file after the snapshot 2024-04-26T18:00:59.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/.snap/snap-subdir-test 2024-04-26T18:00:59.698 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/30 file after the snapshot 2024-04-26T18:00:59.700 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/31 file after the snapshot 2024-04-26T18:00:59.701 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/32 file after the snapshot 2024-04-26T18:00:59.704 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/33 file after the snapshot 2024-04-26T18:00:59.704 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/34 file after the snapshot 2024-04-26T18:00:59.704 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/35 file after the snapshot 2024-04-26T18:00:59.704 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/36 file after the snapshot 2024-04-26T18:00:59.705 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/37 file after the snapshot 2024-04-26T18:00:59.706 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/38 file after the snapshot 2024-04-26T18:00:59.706 INFO:tasks.workunit.client.0.smithi012.stdout: create 192/39 file after the snapshot 2024-04-26T18:00:59.713 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/.snap/snap-subdir-test 2024-04-26T18:00:59.718 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/30 file after the snapshot 2024-04-26T18:00:59.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/31 file after the snapshot 2024-04-26T18:00:59.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/32 file after the snapshot 2024-04-26T18:00:59.721 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/33 file after the snapshot 2024-04-26T18:00:59.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/34 file after the snapshot 2024-04-26T18:00:59.724 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/35 file after the snapshot 2024-04-26T18:00:59.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/36 file after the snapshot 2024-04-26T18:00:59.726 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/37 file after the snapshot 2024-04-26T18:00:59.727 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/38 file after the snapshot 2024-04-26T18:00:59.729 INFO:tasks.workunit.client.0.smithi012.stdout: create 193/39 file after the snapshot 2024-04-26T18:00:59.733 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/.snap/snap-subdir-test 2024-04-26T18:00:59.742 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/30 file after the snapshot 2024-04-26T18:00:59.744 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/31 file after the snapshot 2024-04-26T18:00:59.744 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/32 file after the snapshot 2024-04-26T18:00:59.748 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/33 file after the snapshot 2024-04-26T18:00:59.748 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/34 file after the snapshot 2024-04-26T18:00:59.748 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/35 file after the snapshot 2024-04-26T18:00:59.749 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/36 file after the snapshot 2024-04-26T18:00:59.751 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/37 file after the snapshot 2024-04-26T18:00:59.751 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/38 file after the snapshot 2024-04-26T18:00:59.757 INFO:tasks.workunit.client.0.smithi012.stdout: create 194/39 file after the snapshot 2024-04-26T18:00:59.757 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/.snap/snap-subdir-test 2024-04-26T18:00:59.764 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/30 file after the snapshot 2024-04-26T18:00:59.766 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/31 file after the snapshot 2024-04-26T18:00:59.766 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/32 file after the snapshot 2024-04-26T18:00:59.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/33 file after the snapshot 2024-04-26T18:00:59.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/34 file after the snapshot 2024-04-26T18:00:59.770 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/35 file after the snapshot 2024-04-26T18:00:59.772 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/36 file after the snapshot 2024-04-26T18:00:59.773 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/37 file after the snapshot 2024-04-26T18:00:59.779 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/38 file after the snapshot 2024-04-26T18:00:59.779 INFO:tasks.workunit.client.0.smithi012.stdout: create 195/39 file after the snapshot 2024-04-26T18:00:59.779 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/.snap/snap-subdir-test 2024-04-26T18:00:59.786 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/30 file after the snapshot 2024-04-26T18:00:59.789 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/31 file after the snapshot 2024-04-26T18:00:59.789 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/32 file after the snapshot 2024-04-26T18:00:59.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/33 file after the snapshot 2024-04-26T18:00:59.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/34 file after the snapshot 2024-04-26T18:00:59.793 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/35 file after the snapshot 2024-04-26T18:00:59.794 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/36 file after the snapshot 2024-04-26T18:00:59.796 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/37 file after the snapshot 2024-04-26T18:00:59.796 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/38 file after the snapshot 2024-04-26T18:00:59.802 INFO:tasks.workunit.client.0.smithi012.stdout: create 196/39 file after the snapshot 2024-04-26T18:00:59.802 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/.snap/snap-subdir-test 2024-04-26T18:00:59.812 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/30 file after the snapshot 2024-04-26T18:00:59.813 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/31 file after the snapshot 2024-04-26T18:00:59.814 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/32 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/33 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/34 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/35 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/36 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/37 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/38 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 197/39 file after the snapshot 2024-04-26T18:00:59.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/.snap/snap-subdir-test 2024-04-26T18:00:59.829 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/30 file after the snapshot 2024-04-26T18:00:59.831 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/31 file after the snapshot 2024-04-26T18:00:59.831 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/32 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/33 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/34 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/35 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/36 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/37 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/38 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 198/39 file after the snapshot 2024-04-26T18:00:59.838 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/.snap/snap-subdir-test 2024-04-26T18:00:59.847 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/30 file after the snapshot 2024-04-26T18:00:59.848 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/31 file after the snapshot 2024-04-26T18:00:59.848 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/32 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/33 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/34 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/35 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/36 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/37 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/38 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 199/39 file after the snapshot 2024-04-26T18:00:59.856 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/.snap/snap-subdir-test 2024-04-26T18:00:59.864 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/30 file after the snapshot 2024-04-26T18:00:59.866 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/31 file after the snapshot 2024-04-26T18:00:59.866 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/32 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/33 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/34 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/35 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/36 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/37 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/38 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 200/39 file after the snapshot 2024-04-26T18:00:59.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/.snap/snap-subdir-test 2024-04-26T18:00:59.881 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/30 file after the snapshot 2024-04-26T18:00:59.883 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/31 file after the snapshot 2024-04-26T18:00:59.883 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/32 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/33 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/34 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/35 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/36 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/37 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/38 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 201/39 file after the snapshot 2024-04-26T18:00:59.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/.snap/snap-subdir-test 2024-04-26T18:00:59.899 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/30 file after the snapshot 2024-04-26T18:00:59.902 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/31 file after the snapshot 2024-04-26T18:00:59.902 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/32 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/33 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/34 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/35 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/36 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/37 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/38 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 202/39 file after the snapshot 2024-04-26T18:00:59.908 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/.snap/snap-subdir-test 2024-04-26T18:00:59.917 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/30 file after the snapshot 2024-04-26T18:00:59.919 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/31 file after the snapshot 2024-04-26T18:00:59.919 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/32 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/33 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/34 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/35 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/36 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/37 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/38 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 203/39 file after the snapshot 2024-04-26T18:00:59.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/.snap/snap-subdir-test 2024-04-26T18:00:59.934 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/30 file after the snapshot 2024-04-26T18:00:59.935 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/31 file after the snapshot 2024-04-26T18:00:59.937 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/32 file after the snapshot 2024-04-26T18:00:59.937 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/33 file after the snapshot 2024-04-26T18:01:00.651 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/34 file after the snapshot 2024-04-26T18:01:00.683 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/35 file after the snapshot 2024-04-26T18:01:00.684 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/36 file after the snapshot 2024-04-26T18:01:00.685 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/37 file after the snapshot 2024-04-26T18:01:00.686 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/38 file after the snapshot 2024-04-26T18:01:00.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 204/39 file after the snapshot 2024-04-26T18:01:00.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/.snap/snap-subdir-test 2024-04-26T18:01:00.751 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/30 file after the snapshot 2024-04-26T18:01:00.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/31 file after the snapshot 2024-04-26T18:01:00.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/32 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/33 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/34 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/35 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/36 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/37 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/38 file after the snapshot 2024-04-26T18:01:00.759 INFO:tasks.workunit.client.0.smithi012.stdout: create 205/39 file after the snapshot 2024-04-26T18:01:00.760 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/.snap/snap-subdir-test 2024-04-26T18:01:01.030 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/30 file after the snapshot 2024-04-26T18:01:01.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/31 file after the snapshot 2024-04-26T18:01:01.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/32 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/33 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/34 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/35 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/36 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/37 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/38 file after the snapshot 2024-04-26T18:01:01.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 206/39 file after the snapshot 2024-04-26T18:01:01.040 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/.snap/snap-subdir-test 2024-04-26T18:01:01.051 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/30 file after the snapshot 2024-04-26T18:01:01.059 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/31 file after the snapshot 2024-04-26T18:01:01.060 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/32 file after the snapshot 2024-04-26T18:01:01.060 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/33 file after the snapshot 2024-04-26T18:01:01.061 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/34 file after the snapshot 2024-04-26T18:01:01.062 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/35 file after the snapshot 2024-04-26T18:01:01.063 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/36 file after the snapshot 2024-04-26T18:01:01.064 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/37 file after the snapshot 2024-04-26T18:01:01.065 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/38 file after the snapshot 2024-04-26T18:01:01.066 INFO:tasks.workunit.client.0.smithi012.stdout: create 207/39 file after the snapshot 2024-04-26T18:01:01.068 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/.snap/snap-subdir-test 2024-04-26T18:01:01.079 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/30 file after the snapshot 2024-04-26T18:01:01.080 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/31 file after the snapshot 2024-04-26T18:01:01.080 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/32 file after the snapshot 2024-04-26T18:01:01.081 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/33 file after the snapshot 2024-04-26T18:01:01.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/34 file after the snapshot 2024-04-26T18:01:01.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/35 file after the snapshot 2024-04-26T18:01:01.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/36 file after the snapshot 2024-04-26T18:01:01.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/37 file after the snapshot 2024-04-26T18:01:01.675 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/38 file after the snapshot 2024-04-26T18:01:02.059 INFO:tasks.workunit.client.0.smithi012.stdout: create 208/39 file after the snapshot 2024-04-26T18:01:02.060 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/.snap/snap-subdir-test 2024-04-26T18:01:02.074 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/30 file after the snapshot 2024-04-26T18:01:02.075 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/31 file after the snapshot 2024-04-26T18:01:02.075 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/32 file after the snapshot 2024-04-26T18:01:02.076 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/33 file after the snapshot 2024-04-26T18:01:02.077 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/34 file after the snapshot 2024-04-26T18:01:02.078 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/35 file after the snapshot 2024-04-26T18:01:02.079 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/36 file after the snapshot 2024-04-26T18:01:02.080 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/37 file after the snapshot 2024-04-26T18:01:02.081 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/38 file after the snapshot 2024-04-26T18:01:02.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 209/39 file after the snapshot 2024-04-26T18:01:02.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/.snap/snap-subdir-test 2024-04-26T18:01:02.095 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/30 file after the snapshot 2024-04-26T18:01:02.096 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/31 file after the snapshot 2024-04-26T18:01:02.097 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/32 file after the snapshot 2024-04-26T18:01:02.098 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/33 file after the snapshot 2024-04-26T18:01:02.099 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/34 file after the snapshot 2024-04-26T18:01:02.100 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/35 file after the snapshot 2024-04-26T18:01:02.100 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/36 file after the snapshot 2024-04-26T18:01:02.101 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/37 file after the snapshot 2024-04-26T18:01:02.102 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/38 file after the snapshot 2024-04-26T18:01:02.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 210/39 file after the snapshot 2024-04-26T18:01:02.104 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/.snap/snap-subdir-test 2024-04-26T18:01:02.116 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/30 file after the snapshot 2024-04-26T18:01:02.117 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/31 file after the snapshot 2024-04-26T18:01:02.117 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/32 file after the snapshot 2024-04-26T18:01:02.118 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/33 file after the snapshot 2024-04-26T18:01:02.119 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/34 file after the snapshot 2024-04-26T18:01:02.120 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/35 file after the snapshot 2024-04-26T18:01:02.121 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/36 file after the snapshot 2024-04-26T18:01:02.122 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/37 file after the snapshot 2024-04-26T18:01:02.123 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/38 file after the snapshot 2024-04-26T18:01:02.123 INFO:tasks.workunit.client.0.smithi012.stdout: create 211/39 file after the snapshot 2024-04-26T18:01:02.124 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/.snap/snap-subdir-test 2024-04-26T18:01:02.136 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/30 file after the snapshot 2024-04-26T18:01:02.136 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/31 file after the snapshot 2024-04-26T18:01:02.137 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/32 file after the snapshot 2024-04-26T18:01:02.138 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/33 file after the snapshot 2024-04-26T18:01:02.139 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/34 file after the snapshot 2024-04-26T18:01:02.140 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/35 file after the snapshot 2024-04-26T18:01:02.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/36 file after the snapshot 2024-04-26T18:01:02.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/37 file after the snapshot 2024-04-26T18:01:02.142 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/38 file after the snapshot 2024-04-26T18:01:02.143 INFO:tasks.workunit.client.0.smithi012.stdout: create 212/39 file after the snapshot 2024-04-26T18:01:02.144 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/.snap/snap-subdir-test 2024-04-26T18:01:02.158 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/30 file after the snapshot 2024-04-26T18:01:02.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/31 file after the snapshot 2024-04-26T18:01:02.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/32 file after the snapshot 2024-04-26T18:01:02.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/33 file after the snapshot 2024-04-26T18:01:02.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/34 file after the snapshot 2024-04-26T18:01:02.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/35 file after the snapshot 2024-04-26T18:01:02.160 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/36 file after the snapshot 2024-04-26T18:01:02.161 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/37 file after the snapshot 2024-04-26T18:01:02.161 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/38 file after the snapshot 2024-04-26T18:01:02.162 INFO:tasks.workunit.client.0.smithi012.stdout: create 213/39 file after the snapshot 2024-04-26T18:01:02.163 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/.snap/snap-subdir-test 2024-04-26T18:01:02.173 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/30 file after the snapshot 2024-04-26T18:01:02.174 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/31 file after the snapshot 2024-04-26T18:01:02.176 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/32 file after the snapshot 2024-04-26T18:01:02.176 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/33 file after the snapshot 2024-04-26T18:01:02.177 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/34 file after the snapshot 2024-04-26T18:01:02.177 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/35 file after the snapshot 2024-04-26T18:01:02.178 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/36 file after the snapshot 2024-04-26T18:01:02.179 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/37 file after the snapshot 2024-04-26T18:01:02.180 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/38 file after the snapshot 2024-04-26T18:01:02.181 INFO:tasks.workunit.client.0.smithi012.stdout: create 214/39 file after the snapshot 2024-04-26T18:01:02.182 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/.snap/snap-subdir-test 2024-04-26T18:01:02.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/30 file after the snapshot 2024-04-26T18:01:02.200 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/31 file after the snapshot 2024-04-26T18:01:02.202 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/32 file after the snapshot 2024-04-26T18:01:02.203 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/33 file after the snapshot 2024-04-26T18:01:02.203 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/34 file after the snapshot 2024-04-26T18:01:02.204 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/35 file after the snapshot 2024-04-26T18:01:02.205 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/36 file after the snapshot 2024-04-26T18:01:02.206 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/37 file after the snapshot 2024-04-26T18:01:02.207 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/38 file after the snapshot 2024-04-26T18:01:02.208 INFO:tasks.workunit.client.0.smithi012.stdout: create 215/39 file after the snapshot 2024-04-26T18:01:02.209 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/.snap/snap-subdir-test 2024-04-26T18:01:02.220 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/30 file after the snapshot 2024-04-26T18:01:02.228 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/31 file after the snapshot 2024-04-26T18:01:02.229 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/32 file after the snapshot 2024-04-26T18:01:02.230 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/33 file after the snapshot 2024-04-26T18:01:02.231 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/34 file after the snapshot 2024-04-26T18:01:02.232 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/35 file after the snapshot 2024-04-26T18:01:02.233 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/36 file after the snapshot 2024-04-26T18:01:02.234 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/37 file after the snapshot 2024-04-26T18:01:02.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/38 file after the snapshot 2024-04-26T18:01:02.236 INFO:tasks.workunit.client.0.smithi012.stdout: create 216/39 file after the snapshot 2024-04-26T18:01:02.237 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/.snap/snap-subdir-test 2024-04-26T18:01:02.248 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/30 file after the snapshot 2024-04-26T18:01:02.248 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/31 file after the snapshot 2024-04-26T18:01:02.249 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/32 file after the snapshot 2024-04-26T18:01:02.250 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/33 file after the snapshot 2024-04-26T18:01:02.251 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/34 file after the snapshot 2024-04-26T18:01:02.251 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/35 file after the snapshot 2024-04-26T18:01:02.256 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/36 file after the snapshot 2024-04-26T18:01:02.257 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/37 file after the snapshot 2024-04-26T18:01:02.258 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/38 file after the snapshot 2024-04-26T18:01:02.260 INFO:tasks.workunit.client.0.smithi012.stdout: create 217/39 file after the snapshot 2024-04-26T18:01:02.260 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/.snap/snap-subdir-test 2024-04-26T18:01:02.271 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/30 file after the snapshot 2024-04-26T18:01:02.271 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/31 file after the snapshot 2024-04-26T18:01:02.272 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/32 file after the snapshot 2024-04-26T18:01:02.273 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/33 file after the snapshot 2024-04-26T18:01:02.274 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/34 file after the snapshot 2024-04-26T18:01:02.274 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/35 file after the snapshot 2024-04-26T18:01:02.275 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/36 file after the snapshot 2024-04-26T18:01:02.276 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/37 file after the snapshot 2024-04-26T18:01:02.278 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/38 file after the snapshot 2024-04-26T18:01:02.279 INFO:tasks.workunit.client.0.smithi012.stdout: create 218/39 file after the snapshot 2024-04-26T18:01:02.279 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/.snap/snap-subdir-test 2024-04-26T18:01:02.289 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/30 file after the snapshot 2024-04-26T18:01:02.289 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/31 file after the snapshot 2024-04-26T18:01:02.290 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/32 file after the snapshot 2024-04-26T18:01:02.292 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/33 file after the snapshot 2024-04-26T18:01:02.293 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/34 file after the snapshot 2024-04-26T18:01:02.294 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/35 file after the snapshot 2024-04-26T18:01:02.295 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/36 file after the snapshot 2024-04-26T18:01:02.296 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/37 file after the snapshot 2024-04-26T18:01:02.298 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/38 file after the snapshot 2024-04-26T18:01:02.299 INFO:tasks.workunit.client.0.smithi012.stdout: create 219/39 file after the snapshot 2024-04-26T18:01:02.300 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/.snap/snap-subdir-test 2024-04-26T18:01:02.812 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/30 file after the snapshot 2024-04-26T18:01:02.814 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/31 file after the snapshot 2024-04-26T18:01:02.814 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/32 file after the snapshot 2024-04-26T18:01:02.817 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/33 file after the snapshot 2024-04-26T18:01:02.818 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/34 file after the snapshot 2024-04-26T18:01:02.818 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/35 file after the snapshot 2024-04-26T18:01:02.820 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/36 file after the snapshot 2024-04-26T18:01:02.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/37 file after the snapshot 2024-04-26T18:01:02.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/38 file after the snapshot 2024-04-26T18:01:02.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 220/39 file after the snapshot 2024-04-26T18:01:02.821 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/.snap/snap-subdir-test 2024-04-26T18:01:02.832 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/30 file after the snapshot 2024-04-26T18:01:02.840 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/31 file after the snapshot 2024-04-26T18:01:02.841 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/32 file after the snapshot 2024-04-26T18:01:02.842 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/33 file after the snapshot 2024-04-26T18:01:02.843 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/34 file after the snapshot 2024-04-26T18:01:02.844 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/35 file after the snapshot 2024-04-26T18:01:02.845 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/36 file after the snapshot 2024-04-26T18:01:02.846 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/37 file after the snapshot 2024-04-26T18:01:02.847 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/38 file after the snapshot 2024-04-26T18:01:02.848 INFO:tasks.workunit.client.0.smithi012.stdout: create 221/39 file after the snapshot 2024-04-26T18:01:02.849 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/.snap/snap-subdir-test 2024-04-26T18:01:02.860 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/30 file after the snapshot 2024-04-26T18:01:02.868 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/31 file after the snapshot 2024-04-26T18:01:02.869 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/32 file after the snapshot 2024-04-26T18:01:02.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/33 file after the snapshot 2024-04-26T18:01:02.871 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/34 file after the snapshot 2024-04-26T18:01:02.872 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/35 file after the snapshot 2024-04-26T18:01:02.873 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/36 file after the snapshot 2024-04-26T18:01:02.874 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/37 file after the snapshot 2024-04-26T18:01:02.875 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/38 file after the snapshot 2024-04-26T18:01:02.876 INFO:tasks.workunit.client.0.smithi012.stdout: create 222/39 file after the snapshot 2024-04-26T18:01:02.877 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/.snap/snap-subdir-test 2024-04-26T18:01:02.887 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/30 file after the snapshot 2024-04-26T18:01:02.888 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/31 file after the snapshot 2024-04-26T18:01:02.888 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/32 file after the snapshot 2024-04-26T18:01:02.889 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/33 file after the snapshot 2024-04-26T18:01:02.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/34 file after the snapshot 2024-04-26T18:01:02.891 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/35 file after the snapshot 2024-04-26T18:01:02.892 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/36 file after the snapshot 2024-04-26T18:01:02.892 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/37 file after the snapshot 2024-04-26T18:01:02.893 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/38 file after the snapshot 2024-04-26T18:01:02.894 INFO:tasks.workunit.client.0.smithi012.stdout: create 223/39 file after the snapshot 2024-04-26T18:01:02.895 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/.snap/snap-subdir-test 2024-04-26T18:01:02.973 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/30 file after the snapshot 2024-04-26T18:01:02.973 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/31 file after the snapshot 2024-04-26T18:01:02.974 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/32 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/33 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/34 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/35 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/36 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/37 file after the snapshot 2024-04-26T18:01:02.979 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/38 file after the snapshot 2024-04-26T18:01:02.980 INFO:tasks.workunit.client.0.smithi012.stdout: create 224/39 file after the snapshot 2024-04-26T18:01:02.980 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/.snap/snap-subdir-test 2024-04-26T18:01:02.991 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/30 file after the snapshot 2024-04-26T18:01:02.992 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/31 file after the snapshot 2024-04-26T18:01:02.992 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/32 file after the snapshot 2024-04-26T18:01:02.993 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/33 file after the snapshot 2024-04-26T18:01:02.994 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/34 file after the snapshot 2024-04-26T18:01:02.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/35 file after the snapshot 2024-04-26T18:01:02.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/36 file after the snapshot 2024-04-26T18:01:02.996 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/37 file after the snapshot 2024-04-26T18:01:02.997 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/38 file after the snapshot 2024-04-26T18:01:02.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 225/39 file after the snapshot 2024-04-26T18:01:02.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/.snap/snap-subdir-test 2024-04-26T18:01:03.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/30 file after the snapshot 2024-04-26T18:01:03.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/31 file after the snapshot 2024-04-26T18:01:03.010 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/32 file after the snapshot 2024-04-26T18:01:03.011 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/33 file after the snapshot 2024-04-26T18:01:03.012 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/34 file after the snapshot 2024-04-26T18:01:03.013 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/35 file after the snapshot 2024-04-26T18:01:03.013 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/36 file after the snapshot 2024-04-26T18:01:03.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/37 file after the snapshot 2024-04-26T18:01:03.015 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/38 file after the snapshot 2024-04-26T18:01:03.016 INFO:tasks.workunit.client.0.smithi012.stdout: create 226/39 file after the snapshot 2024-04-26T18:01:03.016 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/.snap/snap-subdir-test 2024-04-26T18:01:03.027 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/30 file after the snapshot 2024-04-26T18:01:03.027 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/31 file after the snapshot 2024-04-26T18:01:03.028 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/32 file after the snapshot 2024-04-26T18:01:03.029 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/33 file after the snapshot 2024-04-26T18:01:03.030 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/34 file after the snapshot 2024-04-26T18:01:03.031 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/35 file after the snapshot 2024-04-26T18:01:03.031 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/36 file after the snapshot 2024-04-26T18:01:03.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/37 file after the snapshot 2024-04-26T18:01:03.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/38 file after the snapshot 2024-04-26T18:01:03.034 INFO:tasks.workunit.client.0.smithi012.stdout: create 227/39 file after the snapshot 2024-04-26T18:01:03.035 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/.snap/snap-subdir-test 2024-04-26T18:01:03.045 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/30 file after the snapshot 2024-04-26T18:01:03.046 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/31 file after the snapshot 2024-04-26T18:01:03.046 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/32 file after the snapshot 2024-04-26T18:01:03.047 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/33 file after the snapshot 2024-04-26T18:01:03.048 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/34 file after the snapshot 2024-04-26T18:01:03.049 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/35 file after the snapshot 2024-04-26T18:01:03.049 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/36 file after the snapshot 2024-04-26T18:01:03.050 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/37 file after the snapshot 2024-04-26T18:01:03.051 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/38 file after the snapshot 2024-04-26T18:01:03.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 228/39 file after the snapshot 2024-04-26T18:01:03.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/.snap/snap-subdir-test 2024-04-26T18:01:03.063 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/30 file after the snapshot 2024-04-26T18:01:03.064 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/31 file after the snapshot 2024-04-26T18:01:03.065 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/32 file after the snapshot 2024-04-26T18:01:03.065 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/33 file after the snapshot 2024-04-26T18:01:03.066 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/34 file after the snapshot 2024-04-26T18:01:03.067 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/35 file after the snapshot 2024-04-26T18:01:03.068 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/36 file after the snapshot 2024-04-26T18:01:03.068 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/37 file after the snapshot 2024-04-26T18:01:03.069 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/38 file after the snapshot 2024-04-26T18:01:03.070 INFO:tasks.workunit.client.0.smithi012.stdout: create 229/39 file after the snapshot 2024-04-26T18:01:03.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/.snap/snap-subdir-test 2024-04-26T18:01:03.081 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/30 file after the snapshot 2024-04-26T18:01:03.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/31 file after the snapshot 2024-04-26T18:01:03.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/32 file after the snapshot 2024-04-26T18:01:03.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/33 file after the snapshot 2024-04-26T18:01:03.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/34 file after the snapshot 2024-04-26T18:01:03.085 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/35 file after the snapshot 2024-04-26T18:01:03.086 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/36 file after the snapshot 2024-04-26T18:01:03.087 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/37 file after the snapshot 2024-04-26T18:01:03.088 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/38 file after the snapshot 2024-04-26T18:01:03.088 INFO:tasks.workunit.client.0.smithi012.stdout: create 230/39 file after the snapshot 2024-04-26T18:01:03.089 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/.snap/snap-subdir-test 2024-04-26T18:01:03.099 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/30 file after the snapshot 2024-04-26T18:01:03.107 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/31 file after the snapshot 2024-04-26T18:01:03.109 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/32 file after the snapshot 2024-04-26T18:01:03.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/33 file after the snapshot 2024-04-26T18:01:03.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/34 file after the snapshot 2024-04-26T18:01:03.112 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/35 file after the snapshot 2024-04-26T18:01:03.112 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/36 file after the snapshot 2024-04-26T18:01:03.113 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/37 file after the snapshot 2024-04-26T18:01:03.114 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/38 file after the snapshot 2024-04-26T18:01:03.115 INFO:tasks.workunit.client.0.smithi012.stdout: create 231/39 file after the snapshot 2024-04-26T18:01:03.116 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/.snap/snap-subdir-test 2024-04-26T18:01:03.126 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/30 file after the snapshot 2024-04-26T18:01:03.127 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/31 file after the snapshot 2024-04-26T18:01:03.128 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/32 file after the snapshot 2024-04-26T18:01:03.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/33 file after the snapshot 2024-04-26T18:01:03.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/34 file after the snapshot 2024-04-26T18:01:03.130 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/35 file after the snapshot 2024-04-26T18:01:03.131 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/36 file after the snapshot 2024-04-26T18:01:03.132 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/37 file after the snapshot 2024-04-26T18:01:03.133 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/38 file after the snapshot 2024-04-26T18:01:03.133 INFO:tasks.workunit.client.0.smithi012.stdout: create 232/39 file after the snapshot 2024-04-26T18:01:03.134 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/.snap/snap-subdir-test 2024-04-26T18:01:03.144 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/30 file after the snapshot 2024-04-26T18:01:03.145 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/31 file after the snapshot 2024-04-26T18:01:03.146 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/32 file after the snapshot 2024-04-26T18:01:03.147 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/33 file after the snapshot 2024-04-26T18:01:03.147 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/34 file after the snapshot 2024-04-26T18:01:03.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/35 file after the snapshot 2024-04-26T18:01:03.149 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/36 file after the snapshot 2024-04-26T18:01:03.150 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/37 file after the snapshot 2024-04-26T18:01:03.150 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/38 file after the snapshot 2024-04-26T18:01:03.151 INFO:tasks.workunit.client.0.smithi012.stdout: create 233/39 file after the snapshot 2024-04-26T18:01:03.152 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/.snap/snap-subdir-test 2024-04-26T18:01:03.162 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/30 file after the snapshot 2024-04-26T18:01:03.163 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/31 file after the snapshot 2024-04-26T18:01:03.164 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/32 file after the snapshot 2024-04-26T18:01:03.165 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/33 file after the snapshot 2024-04-26T18:01:03.165 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/34 file after the snapshot 2024-04-26T18:01:03.166 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/35 file after the snapshot 2024-04-26T18:01:03.167 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/36 file after the snapshot 2024-04-26T18:01:03.167 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/37 file after the snapshot 2024-04-26T18:01:03.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/38 file after the snapshot 2024-04-26T18:01:03.169 INFO:tasks.workunit.client.0.smithi012.stdout: create 234/39 file after the snapshot 2024-04-26T18:01:03.170 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/.snap/snap-subdir-test 2024-04-26T18:01:03.180 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/30 file after the snapshot 2024-04-26T18:01:03.181 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/31 file after the snapshot 2024-04-26T18:01:03.181 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/32 file after the snapshot 2024-04-26T18:01:03.182 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/33 file after the snapshot 2024-04-26T18:01:03.183 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/34 file after the snapshot 2024-04-26T18:01:03.184 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/35 file after the snapshot 2024-04-26T18:01:03.184 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/36 file after the snapshot 2024-04-26T18:01:03.185 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/37 file after the snapshot 2024-04-26T18:01:03.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/38 file after the snapshot 2024-04-26T18:01:03.187 INFO:tasks.workunit.client.0.smithi012.stdout: create 235/39 file after the snapshot 2024-04-26T18:01:03.187 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/.snap/snap-subdir-test 2024-04-26T18:01:03.197 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/30 file after the snapshot 2024-04-26T18:01:03.198 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/31 file after the snapshot 2024-04-26T18:01:03.199 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/32 file after the snapshot 2024-04-26T18:01:03.200 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/33 file after the snapshot 2024-04-26T18:01:03.200 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/34 file after the snapshot 2024-04-26T18:01:03.201 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/35 file after the snapshot 2024-04-26T18:01:03.202 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/36 file after the snapshot 2024-04-26T18:01:03.203 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/37 file after the snapshot 2024-04-26T18:01:03.203 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/38 file after the snapshot 2024-04-26T18:01:03.204 INFO:tasks.workunit.client.0.smithi012.stdout: create 236/39 file after the snapshot 2024-04-26T18:01:03.205 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/.snap/snap-subdir-test 2024-04-26T18:01:03.215 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/30 file after the snapshot 2024-04-26T18:01:03.216 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/31 file after the snapshot 2024-04-26T18:01:03.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/32 file after the snapshot 2024-04-26T18:01:03.218 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/33 file after the snapshot 2024-04-26T18:01:03.218 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/34 file after the snapshot 2024-04-26T18:01:03.439 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/35 file after the snapshot 2024-04-26T18:01:03.447 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/36 file after the snapshot 2024-04-26T18:01:03.471 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/37 file after the snapshot 2024-04-26T18:01:03.739 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/38 file after the snapshot 2024-04-26T18:01:03.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 237/39 file after the snapshot 2024-04-26T18:01:03.999 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/.snap/snap-subdir-test 2024-04-26T18:01:04.684 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/30 file after the snapshot 2024-04-26T18:01:04.685 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/31 file after the snapshot 2024-04-26T18:01:04.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/32 file after the snapshot 2024-04-26T18:01:04.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/33 file after the snapshot 2024-04-26T18:01:04.689 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/34 file after the snapshot 2024-04-26T18:01:04.691 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/35 file after the snapshot 2024-04-26T18:01:04.692 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/36 file after the snapshot 2024-04-26T18:01:04.693 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/37 file after the snapshot 2024-04-26T18:01:04.694 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/38 file after the snapshot 2024-04-26T18:01:04.696 INFO:tasks.workunit.client.0.smithi012.stdout: create 238/39 file after the snapshot 2024-04-26T18:01:04.699 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/.snap/snap-subdir-test 2024-04-26T18:01:04.712 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/30 file after the snapshot 2024-04-26T18:01:04.714 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/31 file after the snapshot 2024-04-26T18:01:04.715 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/32 file after the snapshot 2024-04-26T18:01:04.716 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/33 file after the snapshot 2024-04-26T18:01:04.717 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/34 file after the snapshot 2024-04-26T18:01:04.719 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/35 file after the snapshot 2024-04-26T18:01:04.720 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/36 file after the snapshot 2024-04-26T18:01:04.721 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/37 file after the snapshot 2024-04-26T18:01:04.980 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/38 file after the snapshot 2024-04-26T18:01:04.981 INFO:tasks.workunit.client.0.smithi012.stdout: create 239/39 file after the snapshot 2024-04-26T18:01:04.982 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/.snap/snap-subdir-test 2024-04-26T18:01:04.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/30 file after the snapshot 2024-04-26T18:01:04.999 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/31 file after the snapshot 2024-04-26T18:01:05.000 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/32 file after the snapshot 2024-04-26T18:01:05.001 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/33 file after the snapshot 2024-04-26T18:01:05.002 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/34 file after the snapshot 2024-04-26T18:01:05.003 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/35 file after the snapshot 2024-04-26T18:01:05.004 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/36 file after the snapshot 2024-04-26T18:01:05.004 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/37 file after the snapshot 2024-04-26T18:01:05.005 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/38 file after the snapshot 2024-04-26T18:01:05.006 INFO:tasks.workunit.client.0.smithi012.stdout: create 240/39 file after the snapshot 2024-04-26T18:01:05.007 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/.snap/snap-subdir-test 2024-04-26T18:01:05.021 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/30 file after the snapshot 2024-04-26T18:01:05.022 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/31 file after the snapshot 2024-04-26T18:01:05.023 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/32 file after the snapshot 2024-04-26T18:01:05.024 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/33 file after the snapshot 2024-04-26T18:01:05.025 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/34 file after the snapshot 2024-04-26T18:01:05.026 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/35 file after the snapshot 2024-04-26T18:01:05.027 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/36 file after the snapshot 2024-04-26T18:01:05.036 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/37 file after the snapshot 2024-04-26T18:01:05.037 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/38 file after the snapshot 2024-04-26T18:01:05.038 INFO:tasks.workunit.client.0.smithi012.stdout: create 241/39 file after the snapshot 2024-04-26T18:01:05.039 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/.snap/snap-subdir-test 2024-04-26T18:01:05.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/30 file after the snapshot 2024-04-26T18:01:05.054 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/31 file after the snapshot 2024-04-26T18:01:05.054 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/32 file after the snapshot 2024-04-26T18:01:05.055 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/33 file after the snapshot 2024-04-26T18:01:05.056 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/34 file after the snapshot 2024-04-26T18:01:05.057 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/35 file after the snapshot 2024-04-26T18:01:05.058 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/36 file after the snapshot 2024-04-26T18:01:05.058 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/37 file after the snapshot 2024-04-26T18:01:05.059 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/38 file after the snapshot 2024-04-26T18:01:05.060 INFO:tasks.workunit.client.0.smithi012.stdout: create 242/39 file after the snapshot 2024-04-26T18:01:05.068 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/.snap/snap-subdir-test 2024-04-26T18:01:05.081 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/30 file after the snapshot 2024-04-26T18:01:05.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/31 file after the snapshot 2024-04-26T18:01:05.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/32 file after the snapshot 2024-04-26T18:01:05.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/33 file after the snapshot 2024-04-26T18:01:05.085 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/34 file after the snapshot 2024-04-26T18:01:05.086 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/35 file after the snapshot 2024-04-26T18:01:05.086 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/36 file after the snapshot 2024-04-26T18:01:05.087 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/37 file after the snapshot 2024-04-26T18:01:05.088 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/38 file after the snapshot 2024-04-26T18:01:05.089 INFO:tasks.workunit.client.0.smithi012.stdout: create 243/39 file after the snapshot 2024-04-26T18:01:05.090 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/.snap/snap-subdir-test 2024-04-26T18:01:05.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/30 file after the snapshot 2024-04-26T18:01:05.109 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/31 file after the snapshot 2024-04-26T18:01:05.118 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/32 file after the snapshot 2024-04-26T18:01:05.119 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/33 file after the snapshot 2024-04-26T18:01:05.120 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/34 file after the snapshot 2024-04-26T18:01:05.121 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/35 file after the snapshot 2024-04-26T18:01:05.122 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/36 file after the snapshot 2024-04-26T18:01:05.123 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/37 file after the snapshot 2024-04-26T18:01:05.124 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/38 file after the snapshot 2024-04-26T18:01:05.125 INFO:tasks.workunit.client.0.smithi012.stdout: create 244/39 file after the snapshot 2024-04-26T18:01:05.126 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/.snap/snap-subdir-test 2024-04-26T18:01:05.139 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/30 file after the snapshot 2024-04-26T18:01:05.140 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/31 file after the snapshot 2024-04-26T18:01:05.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/32 file after the snapshot 2024-04-26T18:01:05.142 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/33 file after the snapshot 2024-04-26T18:01:05.145 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/34 file after the snapshot 2024-04-26T18:01:05.154 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/35 file after the snapshot 2024-04-26T18:01:05.155 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/36 file after the snapshot 2024-04-26T18:01:05.156 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/37 file after the snapshot 2024-04-26T18:01:05.157 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/38 file after the snapshot 2024-04-26T18:01:05.158 INFO:tasks.workunit.client.0.smithi012.stdout: create 245/39 file after the snapshot 2024-04-26T18:01:05.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/.snap/snap-subdir-test 2024-04-26T18:01:05.172 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/30 file after the snapshot 2024-04-26T18:01:05.173 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/31 file after the snapshot 2024-04-26T18:01:05.174 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/32 file after the snapshot 2024-04-26T18:01:05.174 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/33 file after the snapshot 2024-04-26T18:01:05.175 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/34 file after the snapshot 2024-04-26T18:01:05.176 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/35 file after the snapshot 2024-04-26T18:01:05.177 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/36 file after the snapshot 2024-04-26T18:01:05.178 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/37 file after the snapshot 2024-04-26T18:01:05.179 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/38 file after the snapshot 2024-04-26T18:01:05.180 INFO:tasks.workunit.client.0.smithi012.stdout: create 246/39 file after the snapshot 2024-04-26T18:01:05.180 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/.snap/snap-subdir-test 2024-04-26T18:01:05.194 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/30 file after the snapshot 2024-04-26T18:01:05.202 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/31 file after the snapshot 2024-04-26T18:01:05.203 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/32 file after the snapshot 2024-04-26T18:01:05.204 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/33 file after the snapshot 2024-04-26T18:01:05.205 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/34 file after the snapshot 2024-04-26T18:01:05.206 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/35 file after the snapshot 2024-04-26T18:01:05.207 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/36 file after the snapshot 2024-04-26T18:01:05.208 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/37 file after the snapshot 2024-04-26T18:01:05.209 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/38 file after the snapshot 2024-04-26T18:01:05.210 INFO:tasks.workunit.client.0.smithi012.stdout: create 247/39 file after the snapshot 2024-04-26T18:01:05.211 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/.snap/snap-subdir-test 2024-04-26T18:01:05.227 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/30 file after the snapshot 2024-04-26T18:01:05.227 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/31 file after the snapshot 2024-04-26T18:01:05.227 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/32 file after the snapshot 2024-04-26T18:01:05.227 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/33 file after the snapshot 2024-04-26T18:01:05.227 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/34 file after the snapshot 2024-04-26T18:01:05.229 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/35 file after the snapshot 2024-04-26T18:01:05.230 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/36 file after the snapshot 2024-04-26T18:01:05.231 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/37 file after the snapshot 2024-04-26T18:01:05.232 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/38 file after the snapshot 2024-04-26T18:01:05.234 INFO:tasks.workunit.client.0.smithi012.stdout: create 248/39 file after the snapshot 2024-04-26T18:01:05.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/.snap/snap-subdir-test 2024-04-26T18:01:05.247 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/30 file after the snapshot 2024-04-26T18:01:05.248 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/31 file after the snapshot 2024-04-26T18:01:05.249 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/32 file after the snapshot 2024-04-26T18:01:05.250 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/33 file after the snapshot 2024-04-26T18:01:05.430 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/34 file after the snapshot 2024-04-26T18:01:05.430 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/35 file after the snapshot 2024-04-26T18:01:05.431 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/36 file after the snapshot 2024-04-26T18:01:05.432 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/37 file after the snapshot 2024-04-26T18:01:05.432 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/38 file after the snapshot 2024-04-26T18:01:05.434 INFO:tasks.workunit.client.0.smithi012.stdout: create 249/39 file after the snapshot 2024-04-26T18:01:05.435 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/.snap/snap-subdir-test 2024-04-26T18:01:05.448 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/30 file after the snapshot 2024-04-26T18:01:05.449 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/31 file after the snapshot 2024-04-26T18:01:05.450 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/32 file after the snapshot 2024-04-26T18:01:05.451 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/33 file after the snapshot 2024-04-26T18:01:05.452 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/34 file after the snapshot 2024-04-26T18:01:05.452 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/35 file after the snapshot 2024-04-26T18:01:05.453 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/36 file after the snapshot 2024-04-26T18:01:05.454 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/37 file after the snapshot 2024-04-26T18:01:05.455 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/38 file after the snapshot 2024-04-26T18:01:05.456 INFO:tasks.workunit.client.0.smithi012.stdout: create 250/39 file after the snapshot 2024-04-26T18:01:05.456 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/.snap/snap-subdir-test 2024-04-26T18:01:05.470 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/30 file after the snapshot 2024-04-26T18:01:05.471 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/31 file after the snapshot 2024-04-26T18:01:05.472 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/32 file after the snapshot 2024-04-26T18:01:05.474 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/33 file after the snapshot 2024-04-26T18:01:05.475 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/34 file after the snapshot 2024-04-26T18:01:05.476 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/35 file after the snapshot 2024-04-26T18:01:05.477 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/36 file after the snapshot 2024-04-26T18:01:05.478 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/37 file after the snapshot 2024-04-26T18:01:05.480 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/38 file after the snapshot 2024-04-26T18:01:05.481 INFO:tasks.workunit.client.0.smithi012.stdout: create 251/39 file after the snapshot 2024-04-26T18:01:05.482 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/.snap/snap-subdir-test 2024-04-26T18:01:05.496 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/30 file after the snapshot 2024-04-26T18:01:05.497 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/31 file after the snapshot 2024-04-26T18:01:05.497 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/32 file after the snapshot 2024-04-26T18:01:05.498 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/33 file after the snapshot 2024-04-26T18:01:05.499 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/34 file after the snapshot 2024-04-26T18:01:05.499 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/35 file after the snapshot 2024-04-26T18:01:05.500 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/36 file after the snapshot 2024-04-26T18:01:05.501 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/37 file after the snapshot 2024-04-26T18:01:05.502 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/38 file after the snapshot 2024-04-26T18:01:05.503 INFO:tasks.workunit.client.0.smithi012.stdout: create 252/39 file after the snapshot 2024-04-26T18:01:05.503 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/.snap/snap-subdir-test 2024-04-26T18:01:05.517 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/30 file after the snapshot 2024-04-26T18:01:05.518 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/31 file after the snapshot 2024-04-26T18:01:05.518 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/32 file after the snapshot 2024-04-26T18:01:05.519 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/33 file after the snapshot 2024-04-26T18:01:05.521 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/34 file after the snapshot 2024-04-26T18:01:05.522 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/35 file after the snapshot 2024-04-26T18:01:05.523 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/36 file after the snapshot 2024-04-26T18:01:05.524 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/37 file after the snapshot 2024-04-26T18:01:05.525 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/38 file after the snapshot 2024-04-26T18:01:05.527 INFO:tasks.workunit.client.0.smithi012.stdout: create 253/39 file after the snapshot 2024-04-26T18:01:05.528 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/.snap/snap-subdir-test 2024-04-26T18:01:05.540 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/30 file after the snapshot 2024-04-26T18:01:05.548 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/31 file after the snapshot 2024-04-26T18:01:05.549 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/32 file after the snapshot 2024-04-26T18:01:05.550 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/33 file after the snapshot 2024-04-26T18:01:05.551 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/34 file after the snapshot 2024-04-26T18:01:05.552 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/35 file after the snapshot 2024-04-26T18:01:05.553 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/36 file after the snapshot 2024-04-26T18:01:05.554 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/37 file after the snapshot 2024-04-26T18:01:05.555 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/38 file after the snapshot 2024-04-26T18:01:05.556 INFO:tasks.workunit.client.0.smithi012.stdout: create 254/39 file after the snapshot 2024-04-26T18:01:05.556 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/.snap/snap-subdir-test 2024-04-26T18:01:05.567 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/30 file after the snapshot 2024-04-26T18:01:05.568 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/31 file after the snapshot 2024-04-26T18:01:05.569 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/32 file after the snapshot 2024-04-26T18:01:05.570 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/33 file after the snapshot 2024-04-26T18:01:05.570 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/34 file after the snapshot 2024-04-26T18:01:05.826 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/35 file after the snapshot 2024-04-26T18:01:05.827 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/36 file after the snapshot 2024-04-26T18:01:05.828 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/37 file after the snapshot 2024-04-26T18:01:05.829 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/38 file after the snapshot 2024-04-26T18:01:05.830 INFO:tasks.workunit.client.0.smithi012.stdout: create 255/39 file after the snapshot 2024-04-26T18:01:05.831 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/.snap/snap-subdir-test 2024-04-26T18:01:05.843 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/30 file after the snapshot 2024-04-26T18:01:05.844 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/31 file after the snapshot 2024-04-26T18:01:05.845 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/32 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/33 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/34 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/35 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/36 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/37 file after the snapshot 2024-04-26T18:01:05.850 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/38 file after the snapshot 2024-04-26T18:01:05.851 INFO:tasks.workunit.client.0.smithi012.stdout: create 256/39 file after the snapshot 2024-04-26T18:01:05.851 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/.snap/snap-subdir-test 2024-04-26T18:01:05.862 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/30 file after the snapshot 2024-04-26T18:01:05.864 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/31 file after the snapshot 2024-04-26T18:01:05.864 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/32 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/33 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/34 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/35 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/36 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/37 file after the snapshot 2024-04-26T18:01:05.870 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/38 file after the snapshot 2024-04-26T18:01:05.871 INFO:tasks.workunit.client.0.smithi012.stdout: create 257/39 file after the snapshot 2024-04-26T18:01:05.871 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/.snap/snap-subdir-test 2024-04-26T18:01:05.881 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/30 file after the snapshot 2024-04-26T18:01:05.882 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/31 file after the snapshot 2024-04-26T18:01:05.883 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/32 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/33 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/34 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/35 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/36 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/37 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/38 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 258/39 file after the snapshot 2024-04-26T18:01:05.890 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/.snap/snap-subdir-test 2024-04-26T18:01:05.899 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/30 file after the snapshot 2024-04-26T18:01:05.901 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/31 file after the snapshot 2024-04-26T18:01:05.901 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/32 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/33 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/34 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/35 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/36 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/37 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/38 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 259/39 file after the snapshot 2024-04-26T18:01:05.909 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/.snap/snap-subdir-test 2024-04-26T18:01:05.918 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/30 file after the snapshot 2024-04-26T18:01:05.921 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/31 file after the snapshot 2024-04-26T18:01:05.921 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/32 file after the snapshot 2024-04-26T18:01:05.926 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/33 file after the snapshot 2024-04-26T18:01:05.927 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/34 file after the snapshot 2024-04-26T18:01:05.927 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/35 file after the snapshot 2024-04-26T18:01:05.927 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/36 file after the snapshot 2024-04-26T18:01:05.927 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/37 file after the snapshot 2024-04-26T18:01:05.928 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/38 file after the snapshot 2024-04-26T18:01:05.929 INFO:tasks.workunit.client.0.smithi012.stdout: create 260/39 file after the snapshot 2024-04-26T18:01:05.931 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/.snap/snap-subdir-test 2024-04-26T18:01:05.943 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/30 file after the snapshot 2024-04-26T18:01:05.945 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/31 file after the snapshot 2024-04-26T18:01:05.945 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/32 file after the snapshot 2024-04-26T18:01:05.952 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/33 file after the snapshot 2024-04-26T18:01:05.952 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/34 file after the snapshot 2024-04-26T18:01:05.952 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/35 file after the snapshot 2024-04-26T18:01:05.952 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/36 file after the snapshot 2024-04-26T18:01:05.952 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/37 file after the snapshot 2024-04-26T18:01:05.953 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/38 file after the snapshot 2024-04-26T18:01:05.954 INFO:tasks.workunit.client.0.smithi012.stdout: create 261/39 file after the snapshot 2024-04-26T18:01:05.955 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/.snap/snap-subdir-test 2024-04-26T18:01:05.967 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/30 file after the snapshot 2024-04-26T18:01:05.969 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/31 file after the snapshot 2024-04-26T18:01:05.969 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/32 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/33 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/34 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/35 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/36 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/37 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/38 file after the snapshot 2024-04-26T18:01:05.976 INFO:tasks.workunit.client.0.smithi012.stdout: create 262/39 file after the snapshot 2024-04-26T18:01:05.977 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/.snap/snap-subdir-test 2024-04-26T18:01:05.986 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/30 file after the snapshot 2024-04-26T18:01:05.987 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/31 file after the snapshot 2024-04-26T18:01:05.988 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/32 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/33 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/34 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/35 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/36 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/37 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/38 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 263/39 file after the snapshot 2024-04-26T18:01:05.995 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/.snap/snap-subdir-test 2024-04-26T18:01:06.005 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/30 file after the snapshot 2024-04-26T18:01:06.007 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/31 file after the snapshot 2024-04-26T18:01:06.007 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/32 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/33 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/34 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/35 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/36 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/37 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/38 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 264/39 file after the snapshot 2024-04-26T18:01:06.014 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/.snap/snap-subdir-test 2024-04-26T18:01:06.023 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/30 file after the snapshot 2024-04-26T18:01:06.025 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/31 file after the snapshot 2024-04-26T18:01:06.026 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/32 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/33 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/34 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/35 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/36 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/37 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/38 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 265/39 file after the snapshot 2024-04-26T18:01:06.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/.snap/snap-subdir-test 2024-04-26T18:01:06.043 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/30 file after the snapshot 2024-04-26T18:01:06.044 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/31 file after the snapshot 2024-04-26T18:01:06.044 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/32 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/33 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/34 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/35 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/36 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/37 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/38 file after the snapshot 2024-04-26T18:01:06.052 INFO:tasks.workunit.client.0.smithi012.stdout: create 266/39 file after the snapshot 2024-04-26T18:01:06.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/.snap/snap-subdir-test 2024-04-26T18:01:06.062 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/30 file after the snapshot 2024-04-26T18:01:06.063 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/31 file after the snapshot 2024-04-26T18:01:06.063 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/32 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/33 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/34 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/35 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/36 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/37 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/38 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 267/39 file after the snapshot 2024-04-26T18:01:06.071 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/.snap/snap-subdir-test 2024-04-26T18:01:06.081 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/30 file after the snapshot 2024-04-26T18:01:06.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/31 file after the snapshot 2024-04-26T18:01:06.083 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/32 file after the snapshot 2024-04-26T18:01:06.090 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/33 file after the snapshot 2024-04-26T18:01:06.090 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/34 file after the snapshot 2024-04-26T18:01:06.090 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/35 file after the snapshot 2024-04-26T18:01:06.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/36 file after the snapshot 2024-04-26T18:01:06.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/37 file after the snapshot 2024-04-26T18:01:06.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/38 file after the snapshot 2024-04-26T18:01:06.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 268/39 file after the snapshot 2024-04-26T18:01:06.091 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/.snap/snap-subdir-test 2024-04-26T18:01:06.099 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/30 file after the snapshot 2024-04-26T18:01:06.100 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/31 file after the snapshot 2024-04-26T18:01:06.101 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/32 file after the snapshot 2024-04-26T18:01:06.101 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/33 file after the snapshot 2024-04-26T18:01:06.102 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/34 file after the snapshot 2024-04-26T18:01:06.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/35 file after the snapshot 2024-04-26T18:01:06.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/36 file after the snapshot 2024-04-26T18:01:06.355 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/37 file after the snapshot 2024-04-26T18:01:06.356 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/38 file after the snapshot 2024-04-26T18:01:06.357 INFO:tasks.workunit.client.0.smithi012.stdout: create 269/39 file after the snapshot 2024-04-26T18:01:06.358 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/.snap/snap-subdir-test 2024-04-26T18:01:06.632 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/30 file after the snapshot 2024-04-26T18:01:06.635 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/31 file after the snapshot 2024-04-26T18:01:06.635 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/32 file after the snapshot 2024-04-26T18:01:06.640 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/33 file after the snapshot 2024-04-26T18:01:06.641 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/34 file after the snapshot 2024-04-26T18:01:06.641 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/35 file after the snapshot 2024-04-26T18:01:06.641 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/36 file after the snapshot 2024-04-26T18:01:06.641 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/37 file after the snapshot 2024-04-26T18:01:06.642 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/38 file after the snapshot 2024-04-26T18:01:06.644 INFO:tasks.workunit.client.0.smithi012.stdout: create 270/39 file after the snapshot 2024-04-26T18:01:06.645 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/.snap/snap-subdir-test 2024-04-26T18:01:06.659 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/30 file after the snapshot 2024-04-26T18:01:06.662 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/31 file after the snapshot 2024-04-26T18:01:06.662 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/32 file after the snapshot 2024-04-26T18:01:06.667 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/33 file after the snapshot 2024-04-26T18:01:06.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/34 file after the snapshot 2024-04-26T18:01:06.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/35 file after the snapshot 2024-04-26T18:01:06.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/36 file after the snapshot 2024-04-26T18:01:06.668 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/37 file after the snapshot 2024-04-26T18:01:06.669 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/38 file after the snapshot 2024-04-26T18:01:06.671 INFO:tasks.workunit.client.0.smithi012.stdout: create 271/39 file after the snapshot 2024-04-26T18:01:06.672 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/.snap/snap-subdir-test 2024-04-26T18:01:06.946 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/30 file after the snapshot 2024-04-26T18:01:06.948 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/31 file after the snapshot 2024-04-26T18:01:06.949 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/32 file after the snapshot 2024-04-26T18:01:06.954 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/33 file after the snapshot 2024-04-26T18:01:06.954 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/34 file after the snapshot 2024-04-26T18:01:06.954 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/35 file after the snapshot 2024-04-26T18:01:06.954 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/36 file after the snapshot 2024-04-26T18:01:06.955 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/37 file after the snapshot 2024-04-26T18:01:06.956 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/38 file after the snapshot 2024-04-26T18:01:06.958 INFO:tasks.workunit.client.0.smithi012.stdout: create 272/39 file after the snapshot 2024-04-26T18:01:06.959 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/.snap/snap-subdir-test 2024-04-26T18:01:06.972 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/30 file after the snapshot 2024-04-26T18:01:06.975 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/31 file after the snapshot 2024-04-26T18:01:06.975 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/32 file after the snapshot 2024-04-26T18:01:06.981 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/33 file after the snapshot 2024-04-26T18:01:06.981 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/34 file after the snapshot 2024-04-26T18:01:06.981 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/35 file after the snapshot 2024-04-26T18:01:06.981 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/36 file after the snapshot 2024-04-26T18:01:06.982 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/37 file after the snapshot 2024-04-26T18:01:06.983 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/38 file after the snapshot 2024-04-26T18:01:06.984 INFO:tasks.workunit.client.0.smithi012.stdout: create 273/39 file after the snapshot 2024-04-26T18:01:06.985 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/.snap/snap-subdir-test 2024-04-26T18:01:06.998 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/30 file after the snapshot 2024-04-26T18:01:07.001 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/31 file after the snapshot 2024-04-26T18:01:07.001 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/32 file after the snapshot 2024-04-26T18:01:07.008 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/33 file after the snapshot 2024-04-26T18:01:07.008 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/34 file after the snapshot 2024-04-26T18:01:07.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/35 file after the snapshot 2024-04-26T18:01:07.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/36 file after the snapshot 2024-04-26T18:01:07.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/37 file after the snapshot 2024-04-26T18:01:07.009 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/38 file after the snapshot 2024-04-26T18:01:07.010 INFO:tasks.workunit.client.0.smithi012.stdout: create 274/39 file after the snapshot 2024-04-26T18:01:07.011 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/.snap/snap-subdir-test 2024-04-26T18:01:07.023 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/30 file after the snapshot 2024-04-26T18:01:07.025 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/31 file after the snapshot 2024-04-26T18:01:07.025 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/32 file after the snapshot 2024-04-26T18:01:07.032 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/33 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/34 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/35 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/36 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/37 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/38 file after the snapshot 2024-04-26T18:01:07.033 INFO:tasks.workunit.client.0.smithi012.stdout: create 275/39 file after the snapshot 2024-04-26T18:01:07.034 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/.snap/snap-subdir-test 2024-04-26T18:01:07.043 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/30 file after the snapshot 2024-04-26T18:01:07.045 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/31 file after the snapshot 2024-04-26T18:01:07.045 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/32 file after the snapshot 2024-04-26T18:01:07.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/33 file after the snapshot 2024-04-26T18:01:07.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/34 file after the snapshot 2024-04-26T18:01:07.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/35 file after the snapshot 2024-04-26T18:01:07.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/36 file after the snapshot 2024-04-26T18:01:07.053 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/37 file after the snapshot 2024-04-26T18:01:07.054 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/38 file after the snapshot 2024-04-26T18:01:07.054 INFO:tasks.workunit.client.0.smithi012.stdout: create 276/39 file after the snapshot 2024-04-26T18:01:07.054 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/.snap/snap-subdir-test 2024-04-26T18:01:07.062 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/30 file after the snapshot 2024-04-26T18:01:07.064 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/31 file after the snapshot 2024-04-26T18:01:07.064 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/32 file after the snapshot 2024-04-26T18:01:07.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/33 file after the snapshot 2024-04-26T18:01:07.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/34 file after the snapshot 2024-04-26T18:01:07.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/35 file after the snapshot 2024-04-26T18:01:07.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/36 file after the snapshot 2024-04-26T18:01:07.072 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/37 file after the snapshot 2024-04-26T18:01:07.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/38 file after the snapshot 2024-04-26T18:01:07.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 277/39 file after the snapshot 2024-04-26T18:01:07.073 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/.snap/snap-subdir-test 2024-04-26T18:01:07.082 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/30 file after the snapshot 2024-04-26T18:01:07.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/31 file after the snapshot 2024-04-26T18:01:07.084 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/32 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/33 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/34 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/35 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/36 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/37 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/38 file after the snapshot 2024-04-26T18:01:07.092 INFO:tasks.workunit.client.0.smithi012.stdout: create 278/39 file after the snapshot 2024-04-26T18:01:07.093 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/.snap/snap-subdir-test 2024-04-26T18:01:07.101 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/30 file after the snapshot 2024-04-26T18:01:07.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/31 file after the snapshot 2024-04-26T18:01:07.103 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/32 file after the snapshot 2024-04-26T18:01:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/33 file after the snapshot 2024-04-26T18:01:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/34 file after the snapshot 2024-04-26T18:01:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/35 file after the snapshot 2024-04-26T18:01:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/36 file after the snapshot 2024-04-26T18:01:07.110 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/37 file after the snapshot 2024-04-26T18:01:07.111 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/38 file after the snapshot 2024-04-26T18:01:07.111 INFO:tasks.workunit.client.0.smithi012.stdout: create 279/39 file after the snapshot 2024-04-26T18:01:07.111 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/.snap/snap-subdir-test 2024-04-26T18:01:07.120 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/30 file after the snapshot 2024-04-26T18:01:07.122 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/31 file after the snapshot 2024-04-26T18:01:07.122 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/32 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/33 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/34 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/35 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/36 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/37 file after the snapshot 2024-04-26T18:01:07.129 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/38 file after the snapshot 2024-04-26T18:01:07.130 INFO:tasks.workunit.client.0.smithi012.stdout: create 280/39 file after the snapshot 2024-04-26T18:01:07.130 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/.snap/snap-subdir-test 2024-04-26T18:01:07.139 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/30 file after the snapshot 2024-04-26T18:01:07.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/31 file after the snapshot 2024-04-26T18:01:07.141 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/32 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/33 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/34 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/35 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/36 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/37 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/38 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 281/39 file after the snapshot 2024-04-26T18:01:07.148 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/.snap/snap-subdir-test 2024-04-26T18:01:07.159 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/30 file after the snapshot 2024-04-26T18:01:07.161 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/31 file after the snapshot 2024-04-26T18:01:07.161 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/32 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/33 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/34 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/35 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/36 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/37 file after the snapshot 2024-04-26T18:01:07.168 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/38 file after the snapshot 2024-04-26T18:01:07.169 INFO:tasks.workunit.client.0.smithi012.stdout: create 282/39 file after the snapshot 2024-04-26T18:01:07.171 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/.snap/snap-subdir-test 2024-04-26T18:01:07.183 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/30 file after the snapshot 2024-04-26T18:01:07.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/31 file after the snapshot 2024-04-26T18:01:07.186 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/32 file after the snapshot 2024-04-26T18:01:07.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/33 file after the snapshot 2024-04-26T18:01:07.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/34 file after the snapshot 2024-04-26T18:01:07.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/35 file after the snapshot 2024-04-26T18:01:07.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/36 file after the snapshot 2024-04-26T18:01:07.192 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/37 file after the snapshot 2024-04-26T18:01:07.193 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/38 file after the snapshot 2024-04-26T18:01:07.194 INFO:tasks.workunit.client.0.smithi012.stdout: create 283/39 file after the snapshot 2024-04-26T18:01:07.195 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/.snap/snap-subdir-test 2024-04-26T18:01:07.208 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/30 file after the snapshot 2024-04-26T18:01:07.210 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/31 file after the snapshot 2024-04-26T18:01:07.210 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/32 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/33 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/34 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/35 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/36 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/37 file after the snapshot 2024-04-26T18:01:07.217 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/38 file after the snapshot 2024-04-26T18:01:07.218 INFO:tasks.workunit.client.0.smithi012.stdout: create 284/39 file after the snapshot 2024-04-26T18:01:07.219 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/.snap/snap-subdir-test 2024-04-26T18:01:07.232 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/30 file after the snapshot 2024-04-26T18:01:07.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/31 file after the snapshot 2024-04-26T18:01:07.235 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/32 file after the snapshot 2024-04-26T18:01:07.241 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/33 file after the snapshot 2024-04-26T18:01:07.241 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/34 file after the snapshot 2024-04-26T18:01:07.241 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/35 file after the snapshot 2024-04-26T18:01:07.241 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/36 file after the snapshot 2024-04-26T18:01:07.241 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/37 file after the snapshot 2024-04-26T18:01:07.242 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/38 file after the snapshot 2024-04-26T18:01:07.243 INFO:tasks.workunit.client.0.smithi012.stdout: create 285/39 file after the snapshot 2024-04-26T18:01:07.244 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/.snap/snap-subdir-test 2024-04-26T18:01:07.256 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/30 file after the snapshot 2024-04-26T18:01:07.257 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/31 file after the snapshot 2024-04-26T18:01:07.257 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/32 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/33 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/34 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/35 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/36 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/37 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/38 file after the snapshot 2024-04-26T18:01:07.265 INFO:tasks.workunit.client.0.smithi012.stdout: create 286/39 file after the snapshot 2024-04-26T18:01:07.266 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/.snap/snap-subdir-test 2024-04-26T18:01:07.277 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/30 file after the snapshot 2024-04-26T18:01:07.279 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/31 file after the snapshot 2024-04-26T18:01:07.279 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/32 file after the snapshot 2024-04-26T18:01:07.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/33 file after the snapshot 2024-04-26T18:01:07.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/34 file after the snapshot 2024-04-26T18:01:07.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/35 file after the snapshot 2024-04-26T18:01:07.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/36 file after the snapshot 2024-04-26T18:01:07.286 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/37 file after the snapshot 2024-04-26T18:01:07.287 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/38 file after the snapshot 2024-04-26T18:01:07.287 INFO:tasks.workunit.client.0.smithi012.stdout: create 287/39 file after the snapshot 2024-04-26T18:01:07.289 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/.snap/snap-subdir-test 2024-04-26T18:01:07.301 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/30 file after the snapshot 2024-04-26T18:01:07.303 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/31 file after the snapshot 2024-04-26T18:01:07.303 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/32 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/33 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/34 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/35 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/36 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/37 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/38 file after the snapshot 2024-04-26T18:01:07.310 INFO:tasks.workunit.client.0.smithi012.stdout: create 288/39 file after the snapshot 2024-04-26T18:01:07.311 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/.snap/snap-subdir-test 2024-04-26T18:01:07.320 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/30 file after the snapshot 2024-04-26T18:01:07.323 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/31 file after the snapshot 2024-04-26T18:01:07.323 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/32 file after the snapshot 2024-04-26T18:01:07.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/33 file after the snapshot 2024-04-26T18:01:07.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/34 file after the snapshot 2024-04-26T18:01:07.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/35 file after the snapshot 2024-04-26T18:01:07.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/36 file after the snapshot 2024-04-26T18:01:07.329 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/37 file after the snapshot 2024-04-26T18:01:07.330 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/38 file after the snapshot 2024-04-26T18:01:07.331 INFO:tasks.workunit.client.0.smithi012.stdout: create 289/39 file after the snapshot 2024-04-26T18:01:07.333 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/.snap/snap-subdir-test 2024-04-26T18:01:07.344 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/30 file after the snapshot 2024-04-26T18:01:07.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/31 file after the snapshot 2024-04-26T18:01:07.346 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/32 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/33 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/34 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/35 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/36 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/37 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/38 file after the snapshot 2024-04-26T18:01:07.354 INFO:tasks.workunit.client.0.smithi012.stdout: create 290/39 file after the snapshot 2024-04-26T18:01:07.355 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/.snap/snap-subdir-test 2024-04-26T18:01:07.363 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/30 file after the snapshot 2024-04-26T18:01:07.366 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/31 file after the snapshot 2024-04-26T18:01:07.366 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/32 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/33 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/34 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/35 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/36 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/37 file after the snapshot 2024-04-26T18:01:07.373 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/38 file after the snapshot 2024-04-26T18:01:07.374 INFO:tasks.workunit.client.0.smithi012.stdout: create 291/39 file after the snapshot 2024-04-26T18:01:07.375 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/.snap/snap-subdir-test 2024-04-26T18:01:07.387 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/30 file after the snapshot 2024-04-26T18:01:07.390 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/31 file after the snapshot 2024-04-26T18:01:07.390 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/32 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/33 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/34 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/35 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/36 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/37 file after the snapshot 2024-04-26T18:01:07.396 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/38 file after the snapshot 2024-04-26T18:01:07.397 INFO:tasks.workunit.client.0.smithi012.stdout: create 292/39 file after the snapshot 2024-04-26T18:01:07.399 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/.snap/snap-subdir-test 2024-04-26T18:01:07.410 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/30 file after the snapshot 2024-04-26T18:01:07.413 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/31 file after the snapshot 2024-04-26T18:01:07.413 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/32 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/33 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/34 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/35 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/36 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/37 file after the snapshot 2024-04-26T18:01:07.420 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/38 file after the snapshot 2024-04-26T18:01:07.421 INFO:tasks.workunit.client.0.smithi012.stdout: create 293/39 file after the snapshot 2024-04-26T18:01:07.422 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/.snap/snap-subdir-test 2024-04-26T18:01:07.628 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/30 file after the snapshot 2024-04-26T18:01:07.630 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/31 file after the snapshot 2024-04-26T18:01:07.631 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/32 file after the snapshot 2024-04-26T18:01:07.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/33 file after the snapshot 2024-04-26T18:01:07.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/34 file after the snapshot 2024-04-26T18:01:07.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/35 file after the snapshot 2024-04-26T18:01:07.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/36 file after the snapshot 2024-04-26T18:01:07.636 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/37 file after the snapshot 2024-04-26T18:01:07.637 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/38 file after the snapshot 2024-04-26T18:01:07.639 INFO:tasks.workunit.client.0.smithi012.stdout: create 294/39 file after the snapshot 2024-04-26T18:01:07.640 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/.snap/snap-subdir-test 2024-04-26T18:01:07.655 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/30 file after the snapshot 2024-04-26T18:01:07.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/31 file after the snapshot 2024-04-26T18:01:07.657 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/32 file after the snapshot 2024-04-26T18:01:07.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/33 file after the snapshot 2024-04-26T18:01:07.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/34 file after the snapshot 2024-04-26T18:01:07.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/35 file after the snapshot 2024-04-26T18:01:07.664 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/36 file after the snapshot 2024-04-26T18:01:07.665 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/37 file after the snapshot 2024-04-26T18:01:07.665 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/38 file after the snapshot 2024-04-26T18:01:07.665 INFO:tasks.workunit.client.0.smithi012.stdout: create 295/39 file after the snapshot 2024-04-26T18:01:07.665 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/.snap/snap-subdir-test 2024-04-26T18:01:07.678 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/30 file after the snapshot 2024-04-26T18:01:07.682 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/31 file after the snapshot 2024-04-26T18:01:07.682 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/32 file after the snapshot 2024-04-26T18:01:07.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/33 file after the snapshot 2024-04-26T18:01:07.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/34 file after the snapshot 2024-04-26T18:01:07.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/35 file after the snapshot 2024-04-26T18:01:07.687 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/36 file after the snapshot 2024-04-26T18:01:07.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/37 file after the snapshot 2024-04-26T18:01:07.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/38 file after the snapshot 2024-04-26T18:01:07.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 296/39 file after the snapshot 2024-04-26T18:01:07.688 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/.snap/snap-subdir-test 2024-04-26T18:01:07.701 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/30 file after the snapshot 2024-04-26T18:01:07.702 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/31 file after the snapshot 2024-04-26T18:01:07.702 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/32 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/33 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/34 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/35 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/36 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/37 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/38 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 297/39 file after the snapshot 2024-04-26T18:01:07.710 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/.snap/snap-subdir-test 2024-04-26T18:01:07.723 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/30 file after the snapshot 2024-04-26T18:01:07.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/31 file after the snapshot 2024-04-26T18:01:07.725 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/32 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/33 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/34 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/35 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/36 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/37 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/38 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 298/39 file after the snapshot 2024-04-26T18:01:07.732 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/.snap/snap-subdir-test 2024-04-26T18:01:07.744 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/30 file after the snapshot 2024-04-26T18:01:07.746 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/31 file after the snapshot 2024-04-26T18:01:07.746 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/32 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/33 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/34 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/35 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/36 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/37 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/38 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout: create 299/39 file after the snapshot 2024-04-26T18:01:07.753 INFO:tasks.workunit.client.0.smithi012.stdout:Take second snapshot .snap/test2 2024-04-26T18:01:07.778 INFO:tasks.workunit.client.0.smithi012.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-04-26T18:01:10.588 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-04-26T18:01:10.588 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-04-26T18:01:10.588 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-04-26T18:01:10.588 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-04-26T18:01:10.589 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-04-26T18:01:10.590 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-04-26T18:01:10.591 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-04-26T18:01:10.592 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-04-26T18:01:10.593 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-04-26T18:01:10.594 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-04-26T18:01:10.594 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-04-26T18:01:10.594 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-04-26T18:01:10.594 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-04-26T18:01:10.737 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-04-26T18:01:10.738 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-04-26T18:01:10.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-04-26T18:01:10.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-04-26T18:01:10.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-04-26T18:01:10.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-04-26T18:01:11.782 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-04-26T18:01:11.782 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-04-26T18:01:11.783 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-04-26T18:01:11.784 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-04-26T18:01:11.785 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-04-26T18:01:11.786 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-04-26T18:01:11.787 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-04-26T18:01:11.788 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-04-26T18:01:11.789 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-04-26T18:01:11.789 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-04-26T18:01:12.739 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-04-26T18:01:12.740 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-04-26T18:01:12.741 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-04-26T18:01:12.742 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-04-26T18:01:12.743 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-04-26T18:01:12.744 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-04-26T18:01:13.143 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-04-26T18:01:13.144 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-04-26T18:01:13.145 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-04-26T18:01:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-04-26T18:01:13.147 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-04-26T18:01:13.148 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-04-26T18:01:13.149 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-04-26T18:01:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-04-26T18:01:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-04-26T18:01:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-04-26T18:01:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-04-26T18:01:13.989 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-04-26T18:01:13.990 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-04-26T18:01:13.991 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-04-26T18:01:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-04-26T18:01:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-04-26T18:01:13.994 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-04-26T18:01:13.995 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-04-26T18:01:13.995 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-04-26T18:01:13.995 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-04-26T18:01:14.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:14.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:15.041 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-04-26T18:01:15.041 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-04-26T18:01:15.042 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-04-26T18:01:15.043 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-04-26T18:01:15.044 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-04-26T18:01:15.045 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-04-26T18:01:15.046 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-04-26T18:01:15.047 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-04-26T18:01:15.048 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-04-26T18:01:15.048 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-04-26T18:01:15.411 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-04-26T18:01:15.412 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-04-26T18:01:15.413 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-04-26T18:01:15.414 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-04-26T18:01:15.415 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-04-26T18:01:15.416 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-04-26T18:01:15.417 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-04-26T18:01:15.919 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-04-26T18:01:15.920 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-04-26T18:01:15.921 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-04-26T18:01:15.922 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-04-26T18:01:15.923 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-04-26T18:01:15.924 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-04-26T18:01:15.925 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-04-26T18:01:16.075 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-04-26T18:01:16.075 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-04-26T18:01:16.075 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-04-26T18:01:16.076 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-04-26T18:01:16.077 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-04-26T18:01:16.078 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-04-26T18:01:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-04-26T18:01:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-04-26T18:01:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-04-26T18:01:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-04-26T18:01:16.079 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-04-26T18:01:16.080 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-04-26T18:01:16.081 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-04-26T18:01:16.082 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-04-26T18:01:16.083 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-04-26T18:01:16.084 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-04-26T18:01:16.084 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-04-26T18:01:16.084 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-04-26T18:01:16.084 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-04-26T18:01:16.084 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-04-26T18:01:16.085 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-04-26T18:01:16.086 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-04-26T18:01:16.086 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-04-26T18:01:16.086 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-04-26T18:01:16.086 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-04-26T18:01:17.269 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-04-26T18:01:17.269 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-04-26T18:01:17.269 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-04-26T18:01:17.269 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-04-26T18:01:17.269 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-04-26T18:01:17.270 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-04-26T18:01:17.271 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-04-26T18:01:17.272 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-04-26T18:01:17.273 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-04-26T18:01:17.274 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-04-26T18:01:17.275 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-04-26T18:01:17.275 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-04-26T18:01:18.177 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-04-26T18:01:18.177 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-04-26T18:01:18.178 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-04-26T18:01:18.179 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-04-26T18:01:18.180 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-04-26T18:01:18.181 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-04-26T18:01:18.182 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-04-26T18:01:18.183 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-04-26T18:01:18.184 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-04-26T18:01:19.974 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-04-26T18:01:19.975 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-04-26T18:01:19.976 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-04-26T18:01:19.977 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-04-26T18:01:19.978 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-04-26T18:01:19.979 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-04-26T18:01:19.980 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-04-26T18:01:20.120 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-04-26T18:01:20.121 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-04-26T18:01:20.122 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-04-26T18:01:20.123 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-04-26T18:01:20.124 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-04-26T18:01:20.125 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-04-26T18:01:20.126 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-04-26T18:01:21.050 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-04-26T18:01:21.050 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-04-26T18:01:21.050 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-04-26T18:01:21.050 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-04-26T18:01:21.051 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-04-26T18:01:21.052 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-04-26T18:01:21.053 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-04-26T18:01:21.054 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-04-26T18:01:21.055 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-04-26T18:01:21.056 INFO:tasks.workunit.client.0.smithi012.stdout:Take third snapshot .snap/test3 2024-04-26T18:01:21.117 INFO:tasks.workunit.client.0.smithi012.stdout:Delete the snapshots... 2024-04-26T18:01:24.798 INFO:tasks.workunit.client.0.smithi012.stdout:.//.snap/test1 2024-04-26T18:01:24.798 INFO:tasks.workunit.client.0.smithi012.stdout:.//.snap/test2 2024-04-26T18:01:24.798 INFO:tasks.workunit.client.0.smithi012.stdout:.//.snap/test3 2024-04-26T18:01:24.801 INFO:tasks.workunit.client.0.smithi012.stdout:./274/.snap/snap-subdir-test 2024-04-26T18:01:24.805 INFO:tasks.workunit.client.0.smithi012.stdout:./166/.snap/snap-subdir-test 2024-04-26T18:01:24.809 INFO:tasks.workunit.client.0.smithi012.stdout:./256/.snap/snap-subdir-test 2024-04-26T18:01:24.813 INFO:tasks.workunit.client.0.smithi012.stdout:./247/.snap/snap-subdir-test 2024-04-26T18:01:24.817 INFO:tasks.workunit.client.0.smithi012.stdout:./248/.snap/snap-subdir-test 2024-04-26T18:01:24.821 INFO:tasks.workunit.client.0.smithi012.stdout:./147/.snap/snap-subdir-test 2024-04-26T18:01:24.825 INFO:tasks.workunit.client.0.smithi012.stdout:./151/.snap/snap-subdir-test 2024-04-26T18:01:24.829 INFO:tasks.workunit.client.0.smithi012.stdout:./170/.snap/snap-subdir-test 2024-04-26T18:01:24.832 INFO:tasks.workunit.client.0.smithi012.stdout:./167/.snap/snap-subdir-test 2024-04-26T18:01:24.837 INFO:tasks.workunit.client.0.smithi012.stdout:./140/.snap/snap-subdir-test 2024-04-26T18:01:24.841 INFO:tasks.workunit.client.0.smithi012.stdout:./142/.snap/snap-subdir-test 2024-04-26T18:01:24.845 INFO:tasks.workunit.client.0.smithi012.stdout:./150/.snap/snap-subdir-test 2024-04-26T18:01:24.849 INFO:tasks.workunit.client.0.smithi012.stdout:./273/.snap/snap-subdir-test 2024-04-26T18:01:24.853 INFO:tasks.workunit.client.0.smithi012.stdout:./269/.snap/snap-subdir-test 2024-04-26T18:01:24.857 INFO:tasks.workunit.client.0.smithi012.stdout:./105/.snap/snap-subdir-test 2024-04-26T18:01:24.861 INFO:tasks.workunit.client.0.smithi012.stdout:./210/.snap/snap-subdir-test 2024-04-26T18:01:24.865 INFO:tasks.workunit.client.0.smithi012.stdout:./265/.snap/snap-subdir-test 2024-04-26T18:01:24.868 INFO:tasks.workunit.client.0.smithi012.stdout:./218/.snap/snap-subdir-test 2024-04-26T18:01:24.872 INFO:tasks.workunit.client.0.smithi012.stdout:./290/.snap/snap-subdir-test 2024-04-26T18:01:24.876 INFO:tasks.workunit.client.0.smithi012.stdout:./149/.snap/snap-subdir-test 2024-04-26T18:01:24.880 INFO:tasks.workunit.client.0.smithi012.stdout:./109/.snap/snap-subdir-test 2024-04-26T18:01:24.886 INFO:tasks.workunit.client.0.smithi012.stdout:./292/.snap/snap-subdir-test 2024-04-26T18:01:24.888 INFO:tasks.workunit.client.0.smithi012.stdout:./242/.snap/snap-subdir-test 2024-04-26T18:01:24.892 INFO:tasks.workunit.client.0.smithi012.stdout:./158/.snap/snap-subdir-test 2024-04-26T18:01:24.896 INFO:tasks.workunit.client.0.smithi012.stdout:./243/.snap/snap-subdir-test 2024-04-26T18:01:24.900 INFO:tasks.workunit.client.0.smithi012.stdout:./106/.snap/snap-subdir-test 2024-04-26T18:01:24.904 INFO:tasks.workunit.client.0.smithi012.stdout:./250/.snap/snap-subdir-test 2024-04-26T18:01:24.908 INFO:tasks.workunit.client.0.smithi012.stdout:./221/.snap/snap-subdir-test 2024-04-26T18:01:24.912 INFO:tasks.workunit.client.0.smithi012.stdout:./244/.snap/snap-subdir-test 2024-04-26T18:01:24.916 INFO:tasks.workunit.client.0.smithi012.stdout:./258/.snap/snap-subdir-test 2024-04-26T18:01:24.920 INFO:tasks.workunit.client.0.smithi012.stdout:./268/.snap/snap-subdir-test 2024-04-26T18:01:24.924 INFO:tasks.workunit.client.0.smithi012.stdout:./189/.snap/snap-subdir-test 2024-04-26T18:01:24.927 INFO:tasks.workunit.client.0.smithi012.stdout:./285/.snap/snap-subdir-test 2024-04-26T18:01:25.188 INFO:tasks.workunit.client.0.smithi012.stdout:./208/.snap/snap-subdir-test 2024-04-26T18:01:25.192 INFO:tasks.workunit.client.0.smithi012.stdout:./288/.snap/snap-subdir-test 2024-04-26T18:01:25.196 INFO:tasks.workunit.client.0.smithi012.stdout:./209/.snap/snap-subdir-test 2024-04-26T18:01:25.200 INFO:tasks.workunit.client.0.smithi012.stdout:./253/.snap/snap-subdir-test 2024-04-26T18:01:25.204 INFO:tasks.workunit.client.0.smithi012.stdout:./249/.snap/snap-subdir-test 2024-04-26T18:01:25.208 INFO:tasks.workunit.client.0.smithi012.stdout:./133/.snap/snap-subdir-test 2024-04-26T18:01:25.213 INFO:tasks.workunit.client.0.smithi012.stdout:./291/.snap/snap-subdir-test 2024-04-26T18:01:25.216 INFO:tasks.workunit.client.0.smithi012.stdout:./226/.snap/snap-subdir-test 2024-04-26T18:01:25.221 INFO:tasks.workunit.client.0.smithi012.stdout:./173/.snap/snap-subdir-test 2024-04-26T18:01:25.224 INFO:tasks.workunit.client.0.smithi012.stdout:./174/.snap/snap-subdir-test 2024-04-26T18:01:25.228 INFO:tasks.workunit.client.0.smithi012.stdout:./299/.snap/snap-subdir-test 2024-04-26T18:01:25.232 INFO:tasks.workunit.client.0.smithi012.stdout:./262/.snap/snap-subdir-test 2024-04-26T18:01:25.235 INFO:tasks.workunit.client.0.smithi012.stdout:./231/.snap/snap-subdir-test 2024-04-26T18:01:25.239 INFO:tasks.workunit.client.0.smithi012.stdout:./214/.snap/snap-subdir-test 2024-04-26T18:01:25.243 INFO:tasks.workunit.client.0.smithi012.stdout:./281/.snap/snap-subdir-test 2024-04-26T18:01:25.247 INFO:tasks.workunit.client.0.smithi012.stdout:./289/.snap/snap-subdir-test 2024-04-26T18:01:25.251 INFO:tasks.workunit.client.0.smithi012.stdout:./283/.snap/snap-subdir-test 2024-04-26T18:01:25.255 INFO:tasks.workunit.client.0.smithi012.stdout:./232/.snap/snap-subdir-test 2024-04-26T18:01:25.258 INFO:tasks.workunit.client.0.smithi012.stdout:./298/.snap/snap-subdir-test 2024-04-26T18:01:25.262 INFO:tasks.workunit.client.0.smithi012.stdout:./233/.snap/snap-subdir-test 2024-04-26T18:01:25.266 INFO:tasks.workunit.client.0.smithi012.stdout:./155/.snap/snap-subdir-test 2024-04-26T18:01:25.675 INFO:tasks.workunit.client.0.smithi012.stdout:./114/.snap/snap-subdir-test 2024-04-26T18:01:25.981 INFO:tasks.workunit.client.0.smithi012.stdout:./159/.snap/snap-subdir-test 2024-04-26T18:01:25.985 INFO:tasks.workunit.client.0.smithi012.stdout:./187/.snap/snap-subdir-test 2024-04-26T18:01:26.635 INFO:tasks.workunit.client.0.smithi012.stdout:./185/.snap/snap-subdir-test 2024-04-26T18:01:26.662 INFO:tasks.workunit.client.0.smithi012.stdout:./293/.snap/snap-subdir-test 2024-04-26T18:01:26.666 INFO:tasks.workunit.client.0.smithi012.stdout:./228/.snap/snap-subdir-test 2024-04-26T18:01:26.671 INFO:tasks.workunit.client.0.smithi012.stdout:./120/.snap/snap-subdir-test 2024-04-26T18:01:26.676 INFO:tasks.workunit.client.0.smithi012.stdout:./110/.snap/snap-subdir-test 2024-04-26T18:01:26.988 INFO:tasks.workunit.client.0.smithi012.stdout:./267/.snap/snap-subdir-test 2024-04-26T18:01:26.993 INFO:tasks.workunit.client.0.smithi012.stdout:./202/.snap/snap-subdir-test 2024-04-26T18:01:26.998 INFO:tasks.workunit.client.0.smithi012.stdout:./137/.snap/snap-subdir-test 2024-04-26T18:01:27.003 INFO:tasks.workunit.client.0.smithi012.stdout:./246/.snap/snap-subdir-test 2024-04-26T18:01:27.007 INFO:tasks.workunit.client.0.smithi012.stdout:./219/.snap/snap-subdir-test 2024-04-26T18:01:27.011 INFO:tasks.workunit.client.0.smithi012.stdout:./198/.snap/snap-subdir-test 2024-04-26T18:01:27.016 INFO:tasks.workunit.client.0.smithi012.stdout:./136/.snap/snap-subdir-test 2024-04-26T18:01:27.021 INFO:tasks.workunit.client.0.smithi012.stdout:./270/.snap/snap-subdir-test 2024-04-26T18:01:27.026 INFO:tasks.workunit.client.0.smithi012.stdout:./125/.snap/snap-subdir-test 2024-04-26T18:01:27.031 INFO:tasks.workunit.client.0.smithi012.stdout:./194/.snap/snap-subdir-test 2024-04-26T18:01:27.036 INFO:tasks.workunit.client.0.smithi012.stdout:./119/.snap/snap-subdir-test 2024-04-26T18:01:27.043 INFO:tasks.workunit.client.0.smithi012.stdout:./297/.snap/snap-subdir-test 2024-04-26T18:01:27.044 INFO:tasks.workunit.client.0.smithi012.stdout:./230/.snap/snap-subdir-test 2024-04-26T18:01:27.048 INFO:tasks.workunit.client.0.smithi012.stdout:./260/.snap/snap-subdir-test 2024-04-26T18:01:27.052 INFO:tasks.workunit.client.0.smithi012.stdout:./157/.snap/snap-subdir-test 2024-04-26T18:01:27.056 INFO:tasks.workunit.client.0.smithi012.stdout:./172/.snap/snap-subdir-test 2024-04-26T18:01:27.060 INFO:tasks.workunit.client.0.smithi012.stdout:./277/.snap/snap-subdir-test 2024-04-26T18:01:27.065 INFO:tasks.workunit.client.0.smithi012.stdout:./186/.snap/snap-subdir-test 2024-04-26T18:01:27.069 INFO:tasks.workunit.client.0.smithi012.stdout:./237/.snap/snap-subdir-test 2024-04-26T18:01:27.072 INFO:tasks.workunit.client.0.smithi012.stdout:./190/.snap/snap-subdir-test 2024-04-26T18:01:27.076 INFO:tasks.workunit.client.0.smithi012.stdout:./213/.snap/snap-subdir-test 2024-04-26T18:01:28.248 INFO:tasks.workunit.client.0.smithi012.stdout:./104/.snap/snap-subdir-test 2024-04-26T18:01:28.940 INFO:tasks.workunit.client.0.smithi012.stdout:./164/.snap/snap-subdir-test 2024-04-26T18:01:28.945 INFO:tasks.workunit.client.0.smithi012.stdout:./112/.snap/snap-subdir-test 2024-04-26T18:01:28.949 INFO:tasks.workunit.client.0.smithi012.stdout:./295/.snap/snap-subdir-test 2024-04-26T18:01:28.954 INFO:tasks.workunit.client.0.smithi012.stdout:./272/.snap/snap-subdir-test 2024-04-26T18:01:28.959 INFO:tasks.workunit.client.0.smithi012.stdout:./100/.snap/snap-subdir-test 2024-04-26T18:01:28.964 INFO:tasks.workunit.client.0.smithi012.stdout:./134/.snap/snap-subdir-test 2024-04-26T18:01:28.969 INFO:tasks.workunit.client.0.smithi012.stdout:./200/.snap/snap-subdir-test 2024-04-26T18:01:29.852 INFO:tasks.workunit.client.0.smithi012.stdout:./115/.snap/snap-subdir-test 2024-04-26T18:01:29.857 INFO:tasks.workunit.client.0.smithi012.stdout:./284/.snap/snap-subdir-test 2024-04-26T18:01:29.862 INFO:tasks.workunit.client.0.smithi012.stdout:./280/.snap/snap-subdir-test 2024-04-26T18:01:29.867 INFO:tasks.workunit.client.0.smithi012.stdout:./116/.snap/snap-subdir-test 2024-04-26T18:01:29.872 INFO:tasks.workunit.client.0.smithi012.stdout:./245/.snap/snap-subdir-test 2024-04-26T18:01:30.305 INFO:tasks.workunit.client.0.smithi012.stdout:./195/.snap/snap-subdir-test 2024-04-26T18:01:30.309 INFO:tasks.workunit.client.0.smithi012.stdout:./138/.snap/snap-subdir-test 2024-04-26T18:01:30.314 INFO:tasks.workunit.client.0.smithi012.stdout:./135/.snap/snap-subdir-test 2024-04-26T18:01:30.319 INFO:tasks.workunit.client.0.smithi012.stdout:./117/.snap/snap-subdir-test 2024-04-26T18:01:30.324 INFO:tasks.workunit.client.0.smithi012.stdout:./241/.snap/snap-subdir-test 2024-04-26T18:01:30.329 INFO:tasks.workunit.client.0.smithi012.stdout:./143/.snap/snap-subdir-test 2024-04-26T18:01:30.334 INFO:tasks.workunit.client.0.smithi012.stdout:./180/.snap/snap-subdir-test 2024-04-26T18:01:30.339 INFO:tasks.workunit.client.0.smithi012.stdout:./126/.snap/snap-subdir-test 2024-04-26T18:01:30.343 INFO:tasks.workunit.client.0.smithi012.stdout:./161/.snap/snap-subdir-test 2024-04-26T18:01:30.348 INFO:tasks.workunit.client.0.smithi012.stdout:./204/.snap/snap-subdir-test 2024-04-26T18:01:30.352 INFO:tasks.workunit.client.0.smithi012.stdout:./176/.snap/snap-subdir-test 2024-04-26T18:01:30.356 INFO:tasks.workunit.client.0.smithi012.stdout:./255/.snap/snap-subdir-test 2024-04-26T18:01:30.361 INFO:tasks.workunit.client.0.smithi012.stdout:./215/.snap/snap-subdir-test 2024-04-26T18:01:30.668 INFO:tasks.workunit.client.0.smithi012.stdout:./111/.snap/snap-subdir-test 2024-04-26T18:01:30.672 INFO:tasks.workunit.client.0.smithi012.stdout:./238/.snap/snap-subdir-test 2024-04-26T18:01:30.677 INFO:tasks.workunit.client.0.smithi012.stdout:./191/.snap/snap-subdir-test 2024-04-26T18:01:30.681 INFO:tasks.workunit.client.0.smithi012.stdout:./184/.snap/snap-subdir-test 2024-04-26T18:01:30.686 INFO:tasks.workunit.client.0.smithi012.stdout:./192/.snap/snap-subdir-test 2024-04-26T18:01:30.690 INFO:tasks.workunit.client.0.smithi012.stdout:./103/.snap/snap-subdir-test 2024-04-26T18:01:30.694 INFO:tasks.workunit.client.0.smithi012.stdout:./128/.snap/snap-subdir-test 2024-04-26T18:01:30.699 INFO:tasks.workunit.client.0.smithi012.stdout:./229/.snap/snap-subdir-test 2024-04-26T18:01:30.703 INFO:tasks.workunit.client.0.smithi012.stdout:./144/.snap/snap-subdir-test 2024-04-26T18:01:30.708 INFO:tasks.workunit.client.0.smithi012.stdout:./146/.snap/snap-subdir-test 2024-04-26T18:01:30.712 INFO:tasks.workunit.client.0.smithi012.stdout:./227/.snap/snap-subdir-test 2024-04-26T18:01:30.716 INFO:tasks.workunit.client.0.smithi012.stdout:./278/.snap/snap-subdir-test 2024-04-26T18:01:30.720 INFO:tasks.workunit.client.0.smithi012.stdout:./141/.snap/snap-subdir-test 2024-04-26T18:01:30.724 INFO:tasks.workunit.client.0.smithi012.stdout:./234/.snap/snap-subdir-test 2024-04-26T18:01:30.728 INFO:tasks.workunit.client.0.smithi012.stdout:./225/.snap/snap-subdir-test 2024-04-26T18:01:30.733 INFO:tasks.workunit.client.0.smithi012.stdout:./182/.snap/snap-subdir-test 2024-04-26T18:01:30.737 INFO:tasks.workunit.client.0.smithi012.stdout:./107/.snap/snap-subdir-test 2024-04-26T18:01:30.741 INFO:tasks.workunit.client.0.smithi012.stdout:./178/.snap/snap-subdir-test 2024-04-26T18:01:30.745 INFO:tasks.workunit.client.0.smithi012.stdout:./266/.snap/snap-subdir-test 2024-04-26T18:01:30.749 INFO:tasks.workunit.client.0.smithi012.stdout:./240/.snap/snap-subdir-test 2024-04-26T18:01:30.753 INFO:tasks.workunit.client.0.smithi012.stdout:./156/.snap/snap-subdir-test 2024-04-26T18:01:30.757 INFO:tasks.workunit.client.0.smithi012.stdout:./131/.snap/snap-subdir-test 2024-04-26T18:01:30.761 INFO:tasks.workunit.client.0.smithi012.stdout:./123/.snap/snap-subdir-test 2024-04-26T18:01:30.765 INFO:tasks.workunit.client.0.smithi012.stdout:./160/.snap/snap-subdir-test 2024-04-26T18:01:30.768 INFO:tasks.workunit.client.0.smithi012.stdout:./165/.snap/snap-subdir-test 2024-04-26T18:01:30.773 INFO:tasks.workunit.client.0.smithi012.stdout:./101/.snap/snap-subdir-test 2024-04-26T18:01:30.777 INFO:tasks.workunit.client.0.smithi012.stdout:./148/.snap/snap-subdir-test 2024-04-26T18:01:30.781 INFO:tasks.workunit.client.0.smithi012.stdout:./168/.snap/snap-subdir-test 2024-04-26T18:01:30.786 INFO:tasks.workunit.client.0.smithi012.stdout:./179/.snap/snap-subdir-test 2024-04-26T18:01:30.791 INFO:tasks.workunit.client.0.smithi012.stdout:./257/.snap/snap-subdir-test 2024-04-26T18:01:30.797 INFO:tasks.workunit.client.0.smithi012.stdout:./252/.snap/snap-subdir-test 2024-04-26T18:01:30.802 INFO:tasks.workunit.client.0.smithi012.stdout:./132/.snap/snap-subdir-test 2024-04-26T18:01:30.807 INFO:tasks.workunit.client.0.smithi012.stdout:./236/.snap/snap-subdir-test 2024-04-26T18:01:30.812 INFO:tasks.workunit.client.0.smithi012.stdout:./211/.snap/snap-subdir-test 2024-04-26T18:01:30.818 INFO:tasks.workunit.client.0.smithi012.stdout:./199/.snap/snap-subdir-test 2024-04-26T18:01:31.079 INFO:tasks.workunit.client.0.smithi012.stdout:./205/.snap/snap-subdir-test 2024-04-26T18:01:31.082 INFO:tasks.workunit.client.0.smithi012.stdout:./163/.snap/snap-subdir-test 2024-04-26T18:01:31.087 INFO:tasks.workunit.client.0.smithi012.stdout:./261/.snap/snap-subdir-test 2024-04-26T18:01:31.092 INFO:tasks.workunit.client.0.smithi012.stdout:./201/.snap/snap-subdir-test 2024-04-26T18:01:31.355 INFO:tasks.workunit.client.0.smithi012.stdout:./282/.snap/snap-subdir-test 2024-04-26T18:01:31.361 INFO:tasks.workunit.client.0.smithi012.stdout:./296/.snap/snap-subdir-test 2024-04-26T18:01:31.366 INFO:tasks.workunit.client.0.smithi012.stdout:./217/.snap/snap-subdir-test 2024-04-26T18:01:31.371 INFO:tasks.workunit.client.0.smithi012.stdout:./153/.snap/snap-subdir-test 2024-04-26T18:01:31.377 INFO:tasks.workunit.client.0.smithi012.stdout:./206/.snap/snap-subdir-test 2024-04-26T18:01:31.639 INFO:tasks.workunit.client.0.smithi012.stdout:./122/.snap/snap-subdir-test 2024-04-26T18:01:31.645 INFO:tasks.workunit.client.0.smithi012.stdout:./162/.snap/snap-subdir-test 2024-04-26T18:01:31.719 INFO:tasks.workunit.client.0.smithi012.stdout:./197/.snap/snap-subdir-test 2024-04-26T18:01:31.725 INFO:tasks.workunit.client.0.smithi012.stdout:./216/.snap/snap-subdir-test 2024-04-26T18:01:34.124 INFO:tasks.workunit.client.0.smithi012.stdout:./254/.snap/snap-subdir-test 2024-04-26T18:01:34.187 INFO:tasks.workunit.client.0.smithi012.stdout:./113/.snap/snap-subdir-test 2024-04-26T18:01:35.245 INFO:tasks.workunit.client.0.smithi012.stdout:./152/.snap/snap-subdir-test 2024-04-26T18:01:35.250 INFO:tasks.workunit.client.0.smithi012.stdout:./121/.snap/snap-subdir-test 2024-04-26T18:01:35.254 INFO:tasks.workunit.client.0.smithi012.stdout:./118/.snap/snap-subdir-test 2024-04-26T18:01:35.260 INFO:tasks.workunit.client.0.smithi012.stdout:./196/.snap/snap-subdir-test 2024-04-26T18:01:35.265 INFO:tasks.workunit.client.0.smithi012.stdout:./124/.snap/snap-subdir-test 2024-04-26T18:01:35.270 INFO:tasks.workunit.client.0.smithi012.stdout:./239/.snap/snap-subdir-test 2024-04-26T18:01:35.275 INFO:tasks.workunit.client.0.smithi012.stdout:./188/.snap/snap-subdir-test 2024-04-26T18:01:35.280 INFO:tasks.workunit.client.0.smithi012.stdout:./287/.snap/snap-subdir-test 2024-04-26T18:01:35.284 INFO:tasks.workunit.client.0.smithi012.stdout:./275/.snap/snap-subdir-test 2024-04-26T18:01:35.289 INFO:tasks.workunit.client.0.smithi012.stdout:./259/.snap/snap-subdir-test 2024-04-26T18:01:35.294 INFO:tasks.workunit.client.0.smithi012.stdout:./224/.snap/snap-subdir-test 2024-04-26T18:01:35.299 INFO:tasks.workunit.client.0.smithi012.stdout:./264/.snap/snap-subdir-test 2024-04-26T18:01:35.304 INFO:tasks.workunit.client.0.smithi012.stdout:./145/.snap/snap-subdir-test 2024-04-26T18:01:35.309 INFO:tasks.workunit.client.0.smithi012.stdout:./279/.snap/snap-subdir-test 2024-04-26T18:01:35.313 INFO:tasks.workunit.client.0.smithi012.stdout:./263/.snap/snap-subdir-test 2024-04-26T18:01:35.318 INFO:tasks.workunit.client.0.smithi012.stdout:./130/.snap/snap-subdir-test 2024-04-26T18:01:35.323 INFO:tasks.workunit.client.0.smithi012.stdout:./193/.snap/snap-subdir-test 2024-04-26T18:01:35.329 INFO:tasks.workunit.client.0.smithi012.stdout:./223/.snap/snap-subdir-test 2024-04-26T18:01:35.333 INFO:tasks.workunit.client.0.smithi012.stdout:./207/.snap/snap-subdir-test 2024-04-26T18:01:35.339 INFO:tasks.workunit.client.0.smithi012.stdout:./276/.snap/snap-subdir-test 2024-04-26T18:01:35.344 INFO:tasks.workunit.client.0.smithi012.stdout:./271/.snap/snap-subdir-test 2024-04-26T18:01:35.606 INFO:tasks.workunit.client.0.smithi012.stdout:./251/.snap/snap-subdir-test 2024-04-26T18:01:35.610 INFO:tasks.workunit.client.0.smithi012.stdout:./175/.snap/snap-subdir-test 2024-04-26T18:01:35.614 INFO:tasks.workunit.client.0.smithi012.stdout:./222/.snap/snap-subdir-test 2024-04-26T18:01:35.618 INFO:tasks.workunit.client.0.smithi012.stdout:./220/.snap/snap-subdir-test 2024-04-26T18:01:35.622 INFO:tasks.workunit.client.0.smithi012.stdout:./203/.snap/snap-subdir-test 2024-04-26T18:01:35.626 INFO:tasks.workunit.client.0.smithi012.stdout:./181/.snap/snap-subdir-test 2024-04-26T18:01:35.630 INFO:tasks.workunit.client.0.smithi012.stdout:./286/.snap/snap-subdir-test 2024-04-26T18:01:35.634 INFO:tasks.workunit.client.0.smithi012.stdout:./127/.snap/snap-subdir-test 2024-04-26T18:01:35.639 INFO:tasks.workunit.client.0.smithi012.stdout:./108/.snap/snap-subdir-test 2024-04-26T18:01:35.643 INFO:tasks.workunit.client.0.smithi012.stdout:./183/.snap/snap-subdir-test 2024-04-26T18:01:35.646 INFO:tasks.workunit.client.0.smithi012.stdout:./294/.snap/snap-subdir-test 2024-04-26T18:01:35.650 INFO:tasks.workunit.client.0.smithi012.stdout:./235/.snap/snap-subdir-test 2024-04-26T18:01:35.654 INFO:tasks.workunit.client.0.smithi012.stdout:./177/.snap/snap-subdir-test 2024-04-26T18:01:35.658 INFO:tasks.workunit.client.0.smithi012.stdout:./169/.snap/snap-subdir-test 2024-04-26T18:01:35.662 INFO:tasks.workunit.client.0.smithi012.stdout:./212/.snap/snap-subdir-test 2024-04-26T18:01:35.925 INFO:tasks.workunit.client.0.smithi012.stdout:./154/.snap/snap-subdir-test 2024-04-26T18:01:35.929 INFO:tasks.workunit.client.0.smithi012.stdout:./171/.snap/snap-subdir-test 2024-04-26T18:01:35.934 INFO:tasks.workunit.client.0.smithi012.stdout:./139/.snap/snap-subdir-test 2024-04-26T18:01:35.939 INFO:tasks.workunit.client.0.smithi012.stdout:./102/.snap/snap-subdir-test 2024-04-26T18:01:36.667 INFO:tasks.workunit.client.0.smithi012.stdout:./129/.snap/snap-subdir-test 2024-04-26T18:01:39.349 INFO:tasks.workunit.client.0.smithi012.stdout:Delete all the files and directories ... 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/19' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/15' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/31' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/36' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/20' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/12' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/39' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/10' 2024-04-26T18:01:41.483 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/34' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/38' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/11' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/16' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/32' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/30' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/14' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/18' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/13' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/33' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/17' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/35' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './100/37' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './100' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/19' 2024-04-26T18:01:41.484 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/15' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/31' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/36' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/20' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/12' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/39' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/10' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/34' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/38' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/11' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/16' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/32' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/30' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/14' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/18' 2024-04-26T18:01:41.485 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/13' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/33' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/17' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/35' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './101/37' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './101' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/19' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/15' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/31' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/36' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/20' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/12' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/39' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/10' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/34' 2024-04-26T18:01:41.486 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/38' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/11' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/16' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/32' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/30' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/14' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/18' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/13' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/33' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/17' 2024-04-26T18:01:41.487 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/35' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './102/37' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './102' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/19' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/15' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/31' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/36' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/20' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/12' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/39' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/10' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/34' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/38' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/11' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/16' 2024-04-26T18:01:41.488 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/32' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/30' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/14' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/18' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/13' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/33' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/17' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/35' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './103/37' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './103' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/19' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/15' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/31' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/36' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/20' 2024-04-26T18:01:41.489 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/12' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/39' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/10' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/34' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/38' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/11' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/16' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/32' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/30' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/14' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/18' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/13' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/33' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/17' 2024-04-26T18:01:41.490 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/35' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './104/37' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './104' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/19' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/15' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/31' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/36' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/20' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/12' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/39' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/10' 2024-04-26T18:01:41.491 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/34' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/38' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/11' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/16' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/32' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/30' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/14' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/18' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/13' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/33' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/17' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/35' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './105/37' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './105' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/19' 2024-04-26T18:01:41.492 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/15' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/31' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/36' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/20' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/12' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/39' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/10' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/34' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/38' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/11' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/16' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/32' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/30' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/14' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/18' 2024-04-26T18:01:41.493 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/13' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/33' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/17' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/35' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './106/37' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './106' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/19' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/15' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/31' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/36' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/20' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/12' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/39' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/10' 2024-04-26T18:01:41.494 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/34' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/38' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/11' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/16' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/32' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/30' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/14' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/18' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/13' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/33' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/17' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/35' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './107/37' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './107' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/19' 2024-04-26T18:01:41.495 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/15' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/31' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/36' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/20' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/12' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/39' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/10' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/34' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/38' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/11' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/16' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/32' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/30' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/14' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/18' 2024-04-26T18:01:41.496 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/13' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/33' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/17' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/35' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './108/37' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './108' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/19' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/15' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/31' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/36' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/20' 2024-04-26T18:01:41.497 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/12' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/39' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/10' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/34' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/38' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/11' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/16' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/32' 2024-04-26T18:01:41.498 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/30' 2024-04-26T18:01:43.039 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/14' 2024-04-26T18:01:43.039 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/18' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/13' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/33' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/17' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/35' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './109/37' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './109' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/19' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/15' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/31' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/36' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/20' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/12' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/39' 2024-04-26T18:01:43.040 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/10' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/34' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/38' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/11' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/16' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/32' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/30' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/14' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/18' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/13' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/33' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/17' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/35' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './110/37' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './110' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/19' 2024-04-26T18:01:43.041 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/15' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/31' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/36' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/20' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/12' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/39' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/10' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/34' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/38' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/11' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/16' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/32' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/30' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/14' 2024-04-26T18:01:43.042 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/18' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/13' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/33' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/17' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/35' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './111/37' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './111' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/19' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/15' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/31' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/36' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/20' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/12' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/39' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/10' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/34' 2024-04-26T18:01:43.043 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/38' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/11' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/16' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/32' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/30' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/14' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/18' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/13' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/33' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/17' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/35' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './112/37' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './112' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/19' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/15' 2024-04-26T18:01:43.044 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/31' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/36' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/20' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/12' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/39' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/10' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/34' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/38' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/11' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/16' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/32' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/30' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/14' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/18' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/13' 2024-04-26T18:01:43.045 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/33' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/17' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/35' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './113/37' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './113' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/19' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/15' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/31' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/36' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/20' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/12' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/39' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/10' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/34' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/38' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/11' 2024-04-26T18:01:43.046 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/16' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/32' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/30' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/14' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/18' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/13' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/33' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/17' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/35' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './114/37' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './114' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/19' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/15' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/31' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/36' 2024-04-26T18:01:43.047 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/20' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/12' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/39' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/10' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/34' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/38' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/11' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/16' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/32' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/30' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/14' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/18' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/13' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/33' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/17' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/35' 2024-04-26T18:01:43.048 INFO:tasks.workunit.client.0.smithi012.stdout:removed './115/37' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './115' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/19' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/15' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/31' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/36' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/20' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/12' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/39' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/10' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/34' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/38' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/11' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/16' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/32' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/30' 2024-04-26T18:01:43.049 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/14' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/18' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/13' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/33' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/17' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/35' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './116/37' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './116' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/19' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/15' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/31' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/36' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/20' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/12' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/39' 2024-04-26T18:01:43.050 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/10' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/34' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/38' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/11' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/16' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/32' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/30' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/14' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/18' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/13' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/33' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/17' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/35' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './117/37' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './117' 2024-04-26T18:01:43.051 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/19' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/15' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/31' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/36' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/20' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/12' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/39' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/10' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/34' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/38' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/11' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/16' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/32' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/30' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/14' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/18' 2024-04-26T18:01:43.052 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/13' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/33' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/17' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/35' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './118/37' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './118' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/19' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/15' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/31' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/36' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/20' 2024-04-26T18:01:43.053 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/12' 2024-04-26T18:01:44.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:44.390 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/39' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/10' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/34' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/38' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/11' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/16' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/32' 2024-04-26T18:01:44.989 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/30' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/14' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/18' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/13' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/33' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/17' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/35' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './119/37' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './119' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/19' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/15' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/31' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/36' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/20' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/12' 2024-04-26T18:01:44.990 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/39' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/10' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/34' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/38' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/11' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/16' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/32' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/30' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/14' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/18' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/13' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/33' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/17' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/35' 2024-04-26T18:01:44.991 INFO:tasks.workunit.client.0.smithi012.stdout:removed './120/37' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './120' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/19' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/15' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/31' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/36' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/20' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/12' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/39' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/10' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/34' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/38' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/11' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/16' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/32' 2024-04-26T18:01:44.992 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/30' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/14' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/18' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/13' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/33' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/17' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/35' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './121/37' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './121' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/19' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/15' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/31' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/36' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/20' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/12' 2024-04-26T18:01:44.993 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/39' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/10' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/34' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/38' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/11' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/16' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/32' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/30' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/14' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/18' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/13' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/33' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/17' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/35' 2024-04-26T18:01:44.994 INFO:tasks.workunit.client.0.smithi012.stdout:removed './122/37' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './122' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/19' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/15' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/31' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/36' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/20' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/12' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/39' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/10' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/34' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/38' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/11' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/16' 2024-04-26T18:01:44.995 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/32' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/30' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/14' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/18' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/13' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/33' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/17' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/35' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './123/37' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './123' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/19' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/15' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/31' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/36' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/20' 2024-04-26T18:01:44.996 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/12' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/39' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/10' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/34' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/38' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/11' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/16' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/32' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/30' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/14' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/18' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/13' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/33' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/17' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/35' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed './124/37' 2024-04-26T18:01:44.997 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './124' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/19' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/15' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/31' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/36' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/20' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/12' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/39' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/10' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/34' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/38' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/11' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/16' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/32' 2024-04-26T18:01:44.998 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/30' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/14' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/18' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/13' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/33' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/17' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/35' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './125/37' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './125' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/19' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/15' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/31' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/36' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/20' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/12' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/39' 2024-04-26T18:01:44.999 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/10' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/34' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/38' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/11' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/16' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/32' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/30' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/14' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/18' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/13' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/33' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/17' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/35' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed './126/37' 2024-04-26T18:01:45.000 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './126' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/19' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/15' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/31' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/36' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/20' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/12' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/39' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/10' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/34' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/38' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/11' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/16' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/32' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/30' 2024-04-26T18:01:45.001 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/14' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/18' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/13' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/33' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/17' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/35' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './127/37' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './127' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/19' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/15' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/31' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/36' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/20' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/12' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/39' 2024-04-26T18:01:45.002 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/10' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/34' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/38' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/11' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/16' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/32' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/30' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/14' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/18' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/13' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/33' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/17' 2024-04-26T18:01:45.003 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/35' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './128/37' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './128' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/19' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/15' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/31' 2024-04-26T18:01:47.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/36' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/20' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/12' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/39' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/10' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/34' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/38' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/11' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/16' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/32' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/30' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/14' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/18' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/13' 2024-04-26T18:01:47.678 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/33' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/17' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/35' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './129/37' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './129' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/19' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/15' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/31' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/36' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/20' 2024-04-26T18:01:47.679 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/12' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/39' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/10' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/34' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/38' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/11' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/16' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/32' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/30' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/14' 2024-04-26T18:01:47.680 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/18' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/13' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/33' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/17' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/35' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './130/37' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './130' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/19' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/15' 2024-04-26T18:01:47.681 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/31' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/36' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/20' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/12' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/39' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/10' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/34' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/38' 2024-04-26T18:01:47.682 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/11' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/16' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/32' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/30' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/14' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/18' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/13' 2024-04-26T18:01:47.683 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/33' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/17' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/35' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './131/37' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './131' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/19' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/15' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/31' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/36' 2024-04-26T18:01:47.684 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/20' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/12' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/39' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/10' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/34' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/38' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/11' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/16' 2024-04-26T18:01:47.685 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/32' 2024-04-26T18:01:47.686 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/30' 2024-04-26T18:01:47.686 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/14' 2024-04-26T18:01:47.686 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/18' 2024-04-26T18:01:47.686 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/13' 2024-04-26T18:01:47.686 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/33' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/17' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/35' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './132/37' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './132' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/19' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/15' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/31' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/36' 2024-04-26T18:01:47.687 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/20' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/12' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/39' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/10' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/34' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/38' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/11' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/16' 2024-04-26T18:01:47.688 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/32' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/30' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/14' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/18' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/13' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/33' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/17' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/35' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed './133/37' 2024-04-26T18:01:47.689 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './133' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/19' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/15' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/31' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/36' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/20' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/12' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/39' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/10' 2024-04-26T18:01:47.690 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/34' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/38' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/11' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/16' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/32' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/30' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/14' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/18' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/13' 2024-04-26T18:01:47.691 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/33' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/17' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/35' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './134/37' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './134' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/19' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/15' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/31' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/36' 2024-04-26T18:01:47.692 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/20' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/12' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/39' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/10' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/34' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/38' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/11' 2024-04-26T18:01:47.693 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/16' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/32' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/30' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/14' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/18' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/13' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/33' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/17' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/35' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './135/37' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './135' 2024-04-26T18:01:47.694 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/19' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/15' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/31' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/36' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/20' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/12' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/39' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/10' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/34' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/38' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/11' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/16' 2024-04-26T18:01:47.695 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/32' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/30' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/14' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/18' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/13' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/33' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/17' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/35' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed './136/37' 2024-04-26T18:01:47.696 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './136' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/19' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/15' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/31' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/36' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/20' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/12' 2024-04-26T18:01:47.697 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/39' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/10' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/34' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/38' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/11' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/16' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/32' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/30' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/14' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/18' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/13' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/33' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/17' 2024-04-26T18:01:47.698 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/35' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './137/37' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './137' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/19' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/15' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/31' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/36' 2024-04-26T18:01:47.699 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/20' 2024-04-26T18:01:47.700 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/12' 2024-04-26T18:01:47.700 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/39' 2024-04-26T18:01:47.700 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/10' 2024-04-26T18:01:47.701 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/34' 2024-04-26T18:01:47.701 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/38' 2024-04-26T18:01:47.701 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/11' 2024-04-26T18:01:47.701 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/16' 2024-04-26T18:01:48.392 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/32' 2024-04-26T18:01:48.392 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/30' 2024-04-26T18:01:48.392 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/14' 2024-04-26T18:01:48.392 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/18' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/13' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/33' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/17' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/35' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed './138/37' 2024-04-26T18:01:48.393 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './138' 2024-04-26T18:01:48.394 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/19' 2024-04-26T18:01:48.394 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/15' 2024-04-26T18:01:48.394 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/31' 2024-04-26T18:01:48.394 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/36' 2024-04-26T18:01:48.394 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/20' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/12' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/39' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/10' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/34' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/38' 2024-04-26T18:01:48.395 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/11' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/16' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/32' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/30' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/14' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/18' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/13' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/33' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/17' 2024-04-26T18:01:48.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/35' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './139/37' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './139' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/19' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/15' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/31' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/36' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/20' 2024-04-26T18:01:48.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/12' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/39' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/10' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/34' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/38' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/11' 2024-04-26T18:01:48.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/16' 2024-04-26T18:01:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/32' 2024-04-26T18:01:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/30' 2024-04-26T18:01:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/14' 2024-04-26T18:01:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/18' 2024-04-26T18:01:48.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/13' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/33' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/17' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/35' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './140/37' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './140' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/19' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/15' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/31' 2024-04-26T18:01:48.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/36' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/20' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/12' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/39' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/10' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/34' 2024-04-26T18:01:48.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/38' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/11' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/16' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/32' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/30' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/14' 2024-04-26T18:01:48.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/18' 2024-04-26T18:01:48.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/13' 2024-04-26T18:01:48.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/33' 2024-04-26T18:01:48.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/17' 2024-04-26T18:01:48.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/35' 2024-04-26T18:01:48.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './141/37' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './141' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/19' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/15' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/31' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/36' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/20' 2024-04-26T18:01:48.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/12' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/39' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/10' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/34' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/38' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/11' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/16' 2024-04-26T18:01:48.405 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/32' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/30' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/14' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/18' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/13' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/33' 2024-04-26T18:01:48.406 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/17' 2024-04-26T18:01:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/35' 2024-04-26T18:01:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:removed './142/37' 2024-04-26T18:01:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './142' 2024-04-26T18:01:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/19' 2024-04-26T18:01:48.407 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/15' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/31' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/36' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/20' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/12' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/39' 2024-04-26T18:01:48.408 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/10' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/34' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/38' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/11' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/16' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/32' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/30' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/14' 2024-04-26T18:01:48.409 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/18' 2024-04-26T18:01:48.410 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/13' 2024-04-26T18:01:48.410 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/33' 2024-04-26T18:01:48.410 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/17' 2024-04-26T18:01:48.410 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/35' 2024-04-26T18:01:48.410 INFO:tasks.workunit.client.0.smithi012.stdout:removed './143/37' 2024-04-26T18:01:48.411 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './143' 2024-04-26T18:01:48.411 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/19' 2024-04-26T18:01:48.411 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/15' 2024-04-26T18:01:48.411 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/31' 2024-04-26T18:01:48.411 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/36' 2024-04-26T18:01:48.412 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/20' 2024-04-26T18:01:48.412 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/12' 2024-04-26T18:01:48.412 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/39' 2024-04-26T18:01:48.412 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/10' 2024-04-26T18:01:48.412 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/34' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/38' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/11' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/16' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/32' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/30' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/14' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/18' 2024-04-26T18:01:48.413 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/13' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/33' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/17' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/35' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed './144/37' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './144' 2024-04-26T18:01:48.414 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/19' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/15' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/31' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/36' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/20' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/12' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/39' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/10' 2024-04-26T18:01:48.415 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/34' 2024-04-26T18:01:48.416 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/38' 2024-04-26T18:01:48.416 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/11' 2024-04-26T18:01:48.416 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/16' 2024-04-26T18:01:48.416 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/32' 2024-04-26T18:01:48.416 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/30' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/14' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/18' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/13' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/33' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/17' 2024-04-26T18:01:48.417 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/35' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './145/37' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './145' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/19' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/15' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/31' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/36' 2024-04-26T18:01:48.418 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/20' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/12' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/39' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/10' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/34' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/38' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/11' 2024-04-26T18:01:48.419 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/16' 2024-04-26T18:01:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/32' 2024-04-26T18:01:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/30' 2024-04-26T18:01:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/14' 2024-04-26T18:01:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/18' 2024-04-26T18:01:48.420 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/13' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/33' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/17' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/35' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed './146/37' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './146' 2024-04-26T18:01:48.421 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/19' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/15' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/31' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/36' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/20' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/12' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/39' 2024-04-26T18:01:48.422 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/10' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/34' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/38' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/11' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/16' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/32' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/30' 2024-04-26T18:01:48.423 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/14' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/18' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/13' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/33' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/17' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/35' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed './147/37' 2024-04-26T18:01:48.424 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './147' 2024-04-26T18:01:48.425 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/19' 2024-04-26T18:01:48.425 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/15' 2024-04-26T18:01:48.425 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/31' 2024-04-26T18:01:48.425 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/36' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/20' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/12' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/39' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/10' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/34' 2024-04-26T18:01:50.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/38' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/11' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/16' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/32' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/30' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/14' 2024-04-26T18:01:50.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/18' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/13' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/33' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/17' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/35' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './148/37' 2024-04-26T18:01:50.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './148' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/19' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/15' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/31' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/36' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/20' 2024-04-26T18:01:50.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/12' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/39' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/10' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/34' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/38' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/11' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/16' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/32' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/30' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/14' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/18' 2024-04-26T18:01:50.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/13' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/33' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/17' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/35' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './149/37' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './149' 2024-04-26T18:01:50.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/19' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/15' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/31' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/36' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/20' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/12' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/39' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/10' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/34' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/38' 2024-04-26T18:01:50.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/11' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/16' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/32' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/30' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/14' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/18' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/13' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/33' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/17' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/35' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './150/37' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './150' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/19' 2024-04-26T18:01:50.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/15' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/31' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/36' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/20' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/12' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/39' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/10' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/34' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/38' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/11' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/16' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/32' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/30' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/14' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/18' 2024-04-26T18:01:50.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/13' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/33' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/17' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/35' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './151/37' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './151' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/19' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/15' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/31' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/36' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/20' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/12' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/39' 2024-04-26T18:01:50.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/10' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/34' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/38' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/11' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/16' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/32' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/30' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/14' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/18' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/13' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/33' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/17' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/35' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed './152/37' 2024-04-26T18:01:50.232 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './152' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/19' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/15' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/31' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/36' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/20' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/12' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/39' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/10' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/34' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/38' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/11' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/16' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/32' 2024-04-26T18:01:50.233 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/30' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/14' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/18' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/13' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/33' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/17' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/35' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './153/37' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './153' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/19' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/15' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/31' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/36' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/20' 2024-04-26T18:01:50.234 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/12' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/39' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/10' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/34' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/38' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/11' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/16' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/32' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/30' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/14' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/18' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/13' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/33' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/17' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/35' 2024-04-26T18:01:50.235 INFO:tasks.workunit.client.0.smithi012.stdout:removed './154/37' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './154' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/19' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/15' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/31' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/36' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/20' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/12' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/39' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/10' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/34' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/38' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/11' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/16' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/32' 2024-04-26T18:01:50.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/30' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/14' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/18' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/13' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/33' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/17' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/35' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './155/37' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './155' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/19' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/15' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/31' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/36' 2024-04-26T18:01:50.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/20' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/12' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/39' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/10' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/34' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/38' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/11' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/16' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/32' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/30' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/14' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/18' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/13' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/33' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/17' 2024-04-26T18:01:50.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/35' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './156/37' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './156' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/19' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/15' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/31' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/36' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/20' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/12' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/39' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/10' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/34' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/38' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/11' 2024-04-26T18:01:50.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/16' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/32' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/30' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/14' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/18' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/13' 2024-04-26T18:01:50.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/33' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/17' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/35' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './157/37' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './157' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/19' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/15' 2024-04-26T18:01:52.746 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/31' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/36' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/20' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/12' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/39' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/10' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/34' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/38' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/11' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/16' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/32' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/30' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/14' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/18' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/13' 2024-04-26T18:01:52.747 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/33' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/17' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/35' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './158/37' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './158' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/19' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/15' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/31' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/36' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/20' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/12' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/39' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/10' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/34' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/38' 2024-04-26T18:01:52.748 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/11' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/16' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/32' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/30' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/14' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/18' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/13' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/33' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/17' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/35' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './159/37' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './159' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/19' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/15' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/31' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/36' 2024-04-26T18:01:52.749 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/20' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/12' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/39' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/10' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/34' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/38' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/11' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/16' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/32' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/30' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/14' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/18' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/13' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/33' 2024-04-26T18:01:52.750 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/17' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/35' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './160/37' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './160' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/19' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/15' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/31' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/36' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/20' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/12' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/39' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/10' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/34' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/38' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/11' 2024-04-26T18:01:52.751 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/16' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/32' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/30' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/14' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/18' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/13' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/33' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/17' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/35' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './161/37' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './161' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/19' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/15' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/31' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/36' 2024-04-26T18:01:52.752 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/20' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/12' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/39' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/10' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/34' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/38' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/11' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/16' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/32' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/30' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/14' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/18' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/13' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/33' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/17' 2024-04-26T18:01:52.753 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/35' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './162/37' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './162' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/19' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/15' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/31' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/36' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/20' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/12' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/39' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/10' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/34' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/38' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/11' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/16' 2024-04-26T18:01:52.754 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/32' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/30' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/14' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/18' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/13' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/33' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/17' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/35' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './163/37' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './163' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/19' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/15' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/31' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/36' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/20' 2024-04-26T18:01:52.755 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/12' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/39' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/10' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/34' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/38' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/11' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/16' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/32' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/30' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/14' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/18' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/13' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/33' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/17' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/35' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed './164/37' 2024-04-26T18:01:52.756 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './164' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/19' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/15' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/31' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/36' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/20' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/12' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/39' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/10' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/34' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/38' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/11' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/16' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/32' 2024-04-26T18:01:52.757 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/30' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/14' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/18' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/13' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/33' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/17' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/35' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './165/37' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './165' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/19' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/15' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/31' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/36' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/20' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/12' 2024-04-26T18:01:52.758 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/39' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/10' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/34' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/38' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/11' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/16' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/32' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/30' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/14' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/18' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/13' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/33' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/17' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/35' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed './166/37' 2024-04-26T18:01:52.759 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './166' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/19' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/15' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/31' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/36' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/20' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/12' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/39' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/10' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/34' 2024-04-26T18:01:52.760 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/38' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/11' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/16' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/32' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/30' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/14' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/18' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/13' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/33' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/17' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/35' 2024-04-26T18:01:54.267 INFO:tasks.workunit.client.0.smithi012.stdout:removed './167/37' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './167' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/19' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/15' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/31' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/36' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/20' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/12' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/39' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/10' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/34' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/38' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/11' 2024-04-26T18:01:54.268 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/16' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/32' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/30' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/14' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/18' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/13' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/33' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/17' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/35' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './168/37' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './168' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/19' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/15' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/31' 2024-04-26T18:01:54.269 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/36' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/20' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/12' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/39' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/10' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/34' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/38' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/11' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/16' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/32' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/30' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/14' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/18' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/13' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/33' 2024-04-26T18:01:54.270 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/17' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/35' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './169/37' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './169' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/19' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/15' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/31' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/36' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/20' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/12' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/39' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/10' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/34' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/38' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/11' 2024-04-26T18:01:54.271 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/16' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/32' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/30' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/14' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/18' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/13' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/33' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/17' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/35' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './170/37' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './170' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/19' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/15' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/31' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/36' 2024-04-26T18:01:54.272 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/20' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/12' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/39' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/10' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/34' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/38' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/11' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/16' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/32' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/30' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/14' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/18' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/13' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/33' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/17' 2024-04-26T18:01:54.273 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/35' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './171/37' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './171' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/19' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/15' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/31' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/36' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/20' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/12' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/39' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/10' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/34' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/38' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/11' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/16' 2024-04-26T18:01:54.274 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/32' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/30' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/14' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/18' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/13' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/33' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/17' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/35' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './172/37' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './172' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/19' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/15' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/31' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/36' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/20' 2024-04-26T18:01:54.275 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/12' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/39' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/10' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/34' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/38' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/11' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/16' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/32' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/30' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/14' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/18' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/13' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/33' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/17' 2024-04-26T18:01:54.276 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/35' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './173/37' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './173' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/19' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/15' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/31' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/36' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/20' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/12' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/39' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/10' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/34' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/38' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/11' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/16' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/32' 2024-04-26T18:01:54.277 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/30' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/14' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/18' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/13' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/33' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/17' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/35' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './174/37' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './174' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/19' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/15' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/31' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/36' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/20' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/12' 2024-04-26T18:01:54.278 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/39' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/10' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/34' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/38' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/11' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/16' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/32' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/30' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/14' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/18' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/13' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/33' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/17' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/35' 2024-04-26T18:01:54.279 INFO:tasks.workunit.client.0.smithi012.stdout:removed './175/37' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './175' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/19' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/15' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/31' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/36' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/20' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/12' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/39' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/10' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/34' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/38' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/11' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/16' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/32' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/30' 2024-04-26T18:01:54.280 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/14' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/18' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/13' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/33' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/17' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/35' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './176/37' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './176' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/19' 2024-04-26T18:01:54.281 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/15' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/31' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/36' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/20' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/12' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/39' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/10' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/34' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/38' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/11' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/16' 2024-04-26T18:01:55.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/32' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/30' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/14' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/18' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/13' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/33' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/17' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/35' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './177/37' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './177' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/19' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/15' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/31' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/36' 2024-04-26T18:01:55.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/20' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/12' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/39' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/10' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/34' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/38' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/11' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/16' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/32' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/30' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/14' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/18' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/13' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/33' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/17' 2024-04-26T18:01:55.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/35' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './178/37' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './178' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/19' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/15' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/31' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/36' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/20' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/12' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/39' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/10' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/34' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/38' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/11' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/16' 2024-04-26T18:01:55.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/32' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/30' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/14' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/18' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/13' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/33' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/17' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/35' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './179/37' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './179' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/19' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/15' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/31' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/36' 2024-04-26T18:01:55.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/20' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/12' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/39' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/10' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/34' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/38' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/11' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/16' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/32' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/30' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/14' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/18' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/13' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/33' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/17' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/35' 2024-04-26T18:01:55.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './180/37' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './180' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/19' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/15' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/31' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/36' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/20' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/12' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/39' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/10' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/34' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/38' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/11' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/16' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/32' 2024-04-26T18:01:55.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/30' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/14' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/18' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/13' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/33' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/17' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/35' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './181/37' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './181' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/19' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/15' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/31' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/36' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/20' 2024-04-26T18:01:55.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/12' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/39' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/10' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/34' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/38' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/11' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/16' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/32' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/30' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/14' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/18' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/13' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/33' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/17' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/35' 2024-04-26T18:01:55.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './182/37' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './182' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/19' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/15' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/31' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/36' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/20' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/12' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/39' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/10' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/34' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/38' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/11' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/16' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/32' 2024-04-26T18:01:55.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/30' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/14' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/18' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/13' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/33' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/17' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/35' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './183/37' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './183' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/19' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/15' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/31' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/36' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/20' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/12' 2024-04-26T18:01:55.141 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/39' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/10' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/34' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/38' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/11' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/16' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/32' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/30' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/14' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/18' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/13' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/33' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/17' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/35' 2024-04-26T18:01:55.142 INFO:tasks.workunit.client.0.smithi012.stdout:removed './184/37' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './184' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/19' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/15' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/31' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/36' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/20' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/12' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/39' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/10' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/34' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/38' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/11' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/16' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/32' 2024-04-26T18:01:55.143 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/30' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/14' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/18' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/13' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/33' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/17' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/35' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './185/37' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './185' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/19' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/15' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/31' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/36' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/20' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/12' 2024-04-26T18:01:55.144 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/39' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/10' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/34' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/38' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/11' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/16' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/32' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/30' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/14' 2024-04-26T18:01:55.145 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/18' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/13' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/33' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/17' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/35' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './186/37' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './186' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/19' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/15' 2024-04-26T18:01:57.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/31' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/36' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/20' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/12' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/39' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/10' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/34' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/38' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/11' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/16' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/32' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/30' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/14' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/18' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/13' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/33' 2024-04-26T18:01:57.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/17' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/35' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './187/37' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './187' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/19' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/15' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/31' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/36' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/20' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/12' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/39' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/10' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/34' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/38' 2024-04-26T18:01:57.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/11' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/16' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/32' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/30' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/14' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/18' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/13' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/33' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/17' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/35' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './188/37' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './188' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/19' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/15' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/31' 2024-04-26T18:01:57.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/36' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/20' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/12' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/39' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/10' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/34' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/38' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/11' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/16' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/32' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/30' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/14' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/18' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/13' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/33' 2024-04-26T18:01:57.772 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/17' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/35' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './189/37' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './189' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/19' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/15' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/31' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/36' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/20' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/12' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/39' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/10' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/34' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/38' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/11' 2024-04-26T18:01:57.773 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/16' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/32' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/30' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/14' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/18' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/13' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/33' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/17' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/35' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './190/37' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './190' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/19' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/15' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/31' 2024-04-26T18:01:57.774 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/36' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/20' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/12' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/39' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/10' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/34' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/38' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/11' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/16' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/32' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/30' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/14' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/18' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/13' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/33' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/17' 2024-04-26T18:01:57.775 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/35' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './191/37' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './191' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/19' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/15' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/31' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/36' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/20' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/12' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/39' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/10' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/34' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/38' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/11' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/16' 2024-04-26T18:01:57.776 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/32' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/30' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/14' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/18' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/13' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/33' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/17' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/35' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './192/37' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './192' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/19' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/15' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/31' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/36' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/20' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/12' 2024-04-26T18:01:57.777 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/39' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/10' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/34' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/38' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/11' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/16' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/32' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/30' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/14' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/18' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/13' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/33' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/17' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/35' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed './193/37' 2024-04-26T18:01:57.778 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './193' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/19' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/15' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/31' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/36' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/20' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/12' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/39' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/10' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/34' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/38' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/11' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/16' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/32' 2024-04-26T18:01:57.779 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/30' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/14' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/18' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/13' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/33' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/17' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/35' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './194/37' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './194' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/19' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/15' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/31' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/36' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/20' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/12' 2024-04-26T18:01:57.780 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/39' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/10' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/34' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/38' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/11' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/16' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/32' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/30' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/14' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/18' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/13' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/33' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/17' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/35' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './195/37' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './195' 2024-04-26T18:01:57.781 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/19' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/15' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/31' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/36' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/20' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/12' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/39' 2024-04-26T18:01:57.782 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/10' 2024-04-26T18:02:01.358 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:02:01.358 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:02:01.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.472+0000 7f9881264640 1 Processor -- start 2024-04-26T18:02:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.472+0000 7f9881264640 1 -- start start 2024-04-26T18:02:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f9881264640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f9881264640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f987c0c89f0 0x7f987c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f9881264640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f987c0736a0 con 0x7f987c0c7c20 2024-04-26T18:02:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f9881264640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f987c0c62e0 con 0x7f987c0c89f0 2024-04-26T18:02:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f9881264640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f987c073940 con 0x7f987c152cb0 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f987c0c89f0 0x7f987c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f987c0c89f0 0x7f987c0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44216/0 (socket says 172.21.15.12:44216) 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 -- 172.21.15.12:0/1177988964 learned_addr learned my addr 172.21.15.12:0/1177988964 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987affd640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 -- 172.21.15.12:0/1177988964 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 msgr2=0x7f987c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 -- 172.21.15.12:0/1177988964 >> v1:172.21.15.100:6789/0 conn(0x7f987c0c7c20 legacy=0x7f987c0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.473+0000 7f987a7fc640 1 -- 172.21.15.12:0/1177988964 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c0c48c0 con 0x7f987c0c89f0 2024-04-26T18:02:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.474+0000 7f987a7fc640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c89f0 0x7f987c0c67c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9870009870 tx=0x7f987002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820d58f46c62e379 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.474+0000 7f9879ffb640 1 -- 172.21.15.12:0/1177988964 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870037070 con 0x7f987c0c89f0 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.474+0000 7f9879ffb640 1 -- 172.21.15.12:0/1177988964 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9870032440 con 0x7f987c0c89f0 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.474+0000 7f9879ffb640 1 -- 172.21.15.12:0/1177988964 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9870032810 con 0x7f987c0c89f0 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 -- 172.21.15.12:0/1177988964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c89f0 msgr2=0x7f987c0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c89f0 0x7f987c0c67c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9870009870 tx=0x7f987002a2a0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 -- 172.21.15.12:0/1177988964 shutdown_connections 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c89f0 0x7f987c0c67c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 --2- 172.21.15.12:0/1177988964 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 -- 172.21.15.12:0/1177988964 >> 172.21.15.12:0/1177988964 conn(0x7f987c068270 msgr2=0x7f987c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 -- 172.21.15.12:0/1177988964 shutdown_connections 2024-04-26T18:02:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.475+0000 7f9881264640 1 -- 172.21.15.12:0/1177988964 wait complete. 2024-04-26T18:02:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.476+0000 7f9881264640 1 Processor -- start 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.476+0000 7f9881264640 1 -- start start 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 0x7f987c1f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f987c0c4d20 con 0x7f987c0c7c20 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f987c0c4ba0 con 0x7f987c0c89f0 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f9881264640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f987c0cdb70 con 0x7f987c152cb0 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44226/0 (socket says 172.21.15.12:44226) 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 -- 172.21.15.12:0/2473431865 learned_addr learned my addr 172.21.15.12:0/2473431865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987a7fc640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 0x7f987c1f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987b7fe640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 -- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 msgr2=0x7f987c0cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c0cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 -- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 msgr2=0x7f987c1f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 0x7f987c1f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987affd640 1 -- 172.21.15.12:0/2473431865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f987c15b680 con 0x7f987c0c7c20 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987a7fc640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 0x7f987c1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.477+0000 7f987b7fe640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f987affd640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f986c00d800 tx=0x7f986c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00b6c0 con 0x7f987c0c7c20 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c019070 con 0x7f987c0c7c20 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986c00ba80 con 0x7f987c0c7c20 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f987c15b960 con 0x7f987c0c7c20 2024-04-26T18:02:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.478+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f987c159da0 con 0x7f987c0c7c20 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.479+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f987c076d20 con 0x7f987c0c7c20 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.479+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f986c00bc20 con 0x7f987c0c7c20 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.480+0000 7f98637fe640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 0x7f986806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.480+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f986c08c460 con 0x7f987c0c7c20 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.480+0000 7f987a7fc640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 0x7f986806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.480+0000 7f987a7fc640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 0x7f986806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9870034000 tx=0x7f987002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.484+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f986c01c360 con 0x7f987c0c7c20 2024-04-26T18:02:01.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.712+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f987c1563f0 con 0x7f987c0c7c20 2024-04-26T18:02:01.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.713+0000 7f98637fe640 1 -- 172.21.15.12:0/2473431865 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f986c05a470 con 0x7f987c0c7c20 2024-04-26T18:02:01.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:02:01.714 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:02:01.714 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:02:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 msgr2=0x7f986806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.715 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 0x7f986806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9870034000 tx=0x7f987002e000 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 msgr2=0x7f987c15a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f986c00d800 tx=0x7f986c00dcc0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 shutdown_connections 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f986806c8f0 0x7f986806edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f987c152cb0 0x7f987c0cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f987c0c89f0 0x7f987c1f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 --2- 172.21.15.12:0/2473431865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f987c0c7c20 0x7f987c15a5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 >> 172.21.15.12:0/2473431865 conn(0x7f987c068270 msgr2=0x7f987c06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 shutdown_connections 2024-04-26T18:02:01.716 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.715+0000 7f9881264640 1 -- 172.21.15.12:0/2473431865 wait complete. 2024-04-26T18:02:01.727 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:02:01.727 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:02:01.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.841+0000 7fa8f21bf640 1 Processor -- start 2024-04-26T18:02:01.841 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.841+0000 7fa8f21bf640 1 -- start start 2024-04-26T18:02:01.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8f21bf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8ec0c6900 0x7fa8ec0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8f21bf640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec156200 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8f21bf640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0cd550 con 0x7fa8ec155e20 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8f21bf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec15c330 con 0x7fa8ec0c6900 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8ebfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8ec0c6900 0x7fa8ec0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8eaffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa8ec0c64b0 0x7fa8ec0c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39786/0 (socket says 172.21.15.12:39786) 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8eaffd640 1 -- 172.21.15.12:0/37398476 learned_addr learned my addr 172.21.15.12:0/37398476 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8ebfff640 1 -- 172.21.15.12:0/37398476 >> v1:172.21.15.100:6789/0 conn(0x7fa8ec155e20 legacy=0x7fa8ec15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8ebfff640 1 -- 172.21.15.12:0/37398476 >> v1:172.21.15.12:6789/0 conn(0x7fa8ec0c64b0 legacy=0x7fa8ec0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8ebfff640 1 -- 172.21.15.12:0/37398476 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec15c610 con 0x7fa8ec0c6900 2024-04-26T18:02:01.843 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.842+0000 7fa8ea7fc640 1 -- 172.21.15.12:0/37398476 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897960953 0 0) 0x7fa8ec156200 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/37398476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec0cc1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009d90 tx=0x7fa8e402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc404748cf11c464 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8ea7fc640 1 -- 172.21.15.12:0/37398476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037070 con 0x7fa8ec0c6900 2024-04-26T18:02:01.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8ea7fc640 1 -- 172.21.15.12:0/37398476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4007740 con 0x7fa8ec0c6900 2024-04-26T18:02:01.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8ea7fc640 1 -- 172.21.15.12:0/37398476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4007b10 con 0x7fa8ec0c6900 2024-04-26T18:02:01.845 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8f21bf640 1 -- 172.21.15.12:0/37398476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c6900 msgr2=0x7fa8ec0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/37398476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec0cc1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8e4009d90 tx=0x7fa8e402a780 comp rx=0 tx=0).stop 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8f21bf640 1 -- 172.21.15.12:0/37398476 shutdown_connections 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/37398476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec0cc1c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.843+0000 7fa8f21bf640 1 -- 172.21.15.12:0/37398476 >> 172.21.15.12:0/37398476 conn(0x7fa8ec072930 msgr2=0x7fa8ec072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.844+0000 7fa8f21bf640 1 -- 172.21.15.12:0/37398476 shutdown_connections 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.844+0000 7fa8f21bf640 1 -- 172.21.15.12:0/37398476 wait complete. 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.845+0000 7fa8f21bf640 1 Processor -- start 2024-04-26T18:02:01.846 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.845+0000 7fa8f21bf640 1 -- start start 2024-04-26T18:02:01.849 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 0x7fa8ec157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0c72d0 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec0c6ff0 con 0x7fa8ec0c6900 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0c7f00 con 0x7fa8ec155e20 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44244/0 (socket says 172.21.15.12:44244) 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1470412182 learned_addr learned my addr 172.21.15.12:0/1470412182 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.850 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 0x7fa8ec157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 msgr2=0x7fa8ec157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 0x7fa8ec157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8ec0c6900 msgr2=0x7fa8ec14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1470412182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec1f24e0 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 0x7fa8ec157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c450 tx=0x7fa8dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8d3fff640 1 -- 172.21.15.12:0/1470412182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc0052d0 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8d3fff640 1 -- 172.21.15.12:0/1470412182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc005470 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec157cc0 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8d3fff640 1 -- 172.21.15.12:0/1470412182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc012870 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.847+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec1f2780 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.848+0000 7fa8d3fff640 1 -- 172.21.15.12:0/1470412182 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8dc012a10 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.848+0000 7fa8d3fff640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 0x7fa8d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.849+0000 7fa8d3fff640 1 -- 172.21.15.12:0/1470412182 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7fa8dc08bb50 con 0x7fa8ec0c64b0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.849+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 0x7fa8d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.849+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 0x7fa8d806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec154f00 tx=0x7fa8e0007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.849+0000 7fa8f4fbc740 1 Processor -- start 2024-04-26T18:02:01.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.849+0000 7fa8f4fbc740 1 -- start start 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20bdb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20bdbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cd20b3ed80 con 0x55cd20c1aae0 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd20adac20 con 0x55cd20bdb5e0 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55cd20b3ad40 con 0x55cd20bdcb40 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8eaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20bdb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.859 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:55180/0 (socket says 172.21.15.12:55180) 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/3410014139 learned_addr learned my addr 172.21.15.12:0/3410014139 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.850+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20bdbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 msgr2=0x55cd20bdbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20bdbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/3410014139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 msgr2=0x55cd20bdb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20bdb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/3410014139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2091cd80 con 0x55cd20bdb5e0 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20bdb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc089c00 tx=0x7fa8dc059b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e1cf45a456abb44 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.860 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8d17fa640 1 -- 172.21.15.12:0/3410014139 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc062040 con 0x55cd20bdb5e0 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8d17fa640 1 -- 172.21.15.12:0/3410014139 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc0576d0 con 0x55cd20bdb5e0 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.851+0000 7fa8d17fa640 1 -- 172.21.15.12:0/3410014139 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc055a40 con 0x55cd20bdb5e0 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 msgr2=0x55cd20c1a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc089c00 tx=0x7fa8dc059b90 comp rx=0 tx=0).stop 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3410014139 shutdown_connections 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20bdbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20bdb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3410014139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20c1a5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3410014139 >> 172.21.15.12:0/3410014139 conn(0x55cd20ba2740 msgr2=0x55cd20c1f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3410014139 shutdown_connections 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3410014139 wait complete. 2024-04-26T18:02:01.861 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.852+0000 7fa8f4fbc740 1 -- start start 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 Processor -- start 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c2f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c025e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cd20adac20 con 0x55cd20bdb5e0 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd20ad8840 con 0x55cd20c1aae0 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55cd20bd9c20 con 0x55cd20bdcb40 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 10 client.0 _ll_register_callbacks cb 0x55cd20adc5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44266/0 (socket says 172.21.15.12:44266) 2024-04-26T18:02:01.862 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1883461865 learned_addr learned my addr 172.21.15.12:0/1883461865 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c025e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c2f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 msgr2=0x55cd20c2f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c2f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 msgr2=0x55cd20c025e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c025e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 -- 172.21.15.12:0/1883461865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2097d510 con 0x55cd20bdb5e0 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00ce10 tx=0x7fa8dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01fd713f446cdc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:01.863 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc087070 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7fa8dc058820 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8dc0576d0 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa8dc058a40 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 10 client.4914 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd20810670 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.854+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc0576d0 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa8dc055120 con 0x55cd20bdb5e0 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 10 client.4914 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 10 client.4914 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 20 client.4914 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c02b20 0x55cd20c39240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.864 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 4 client.4914 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd20b4c990 con 0x55cd20c02b20 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c02b20 0x55cd20c39240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c02b20 0x55cd20c39240 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12265ed1e19d32f9 server_cookie=b852cd51a70319f7 in_seq=0 out_seq=0 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.855+0000 7fa8ca7fc640 10 client.4914 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/1883461865 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd20b4c990 con 0x55cd20c02b20 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8ca7fc640 10 client.4914 handle_command_reply: tid=0 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 client.4914 shutdown 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 msgr2=0x55cd20bd4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00ce10 tx=0x7fa8dc000ed0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 shutdown_connections 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c02b20 0x55cd20c39240 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.865 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c2f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8ca7fc640 0 client.4914 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/1883461865 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd4fa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 >> 172.21.15.12:0/1883461865 conn(0x55cd20ba2740 msgr2=0x55cd20c04190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 shutdown_connections 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.856+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/1883461865 wait complete. 2024-04-26T18:02:01.866 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.857+0000 7fa8f4fbc740 20 client.4914 trim_cache size 0 max 16384 2024-04-26T18:02:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.874+0000 7fa8f4fbc740 1 Processor -- start 2024-04-26T18:02:01.874 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.874+0000 7fa8f4fbc740 1 -- start start 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/34' 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/38' 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/11' 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/16' 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/32' 2024-04-26T18:02:01.875 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/30' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/14' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/18' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/13' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/33' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/17' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/35' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './196/37' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './196' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/19' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/15' 2024-04-26T18:02:01.876 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/31' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/36' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/20' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/12' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/39' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/10' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/34' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/38' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/11' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/16' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/32' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/30' 2024-04-26T18:02:01.877 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/14' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/18' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/13' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/33' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/17' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/35' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './197/37' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './197' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/19' 2024-04-26T18:02:01.878 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/15' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/31' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/36' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/20' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/12' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/39' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/10' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/34' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/38' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/11' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/16' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/32' 2024-04-26T18:02:01.879 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/30' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/14' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/18' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/13' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/33' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/17' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/35' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './198/37' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './198' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/19' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/15' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/31' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/36' 2024-04-26T18:02:01.880 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/20' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/12' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/39' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/10' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/34' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/38' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/11' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/16' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/32' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/30' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/14' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/18' 2024-04-26T18:02:01.881 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/13' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/33' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/17' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/35' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './199/37' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './199' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/21' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/27' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/31' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/36' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/20' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/39' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/34' 2024-04-26T18:02:01.882 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/38' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/28' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/24' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/29' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/32' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/22' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/25' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/30' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/33' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/23' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/35' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/26' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed './200/37' 2024-04-26T18:02:01.883 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './200' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/21' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/27' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/31' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/36' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/20' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/39' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/34' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/38' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/28' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/24' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/29' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/32' 2024-04-26T18:02:01.884 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/22' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/25' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/30' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/33' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/23' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/35' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/26' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './201/37' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './201' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/21' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/27' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/31' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/36' 2024-04-26T18:02:01.885 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/20' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/39' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/34' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/38' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/28' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/24' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/29' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/32' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/22' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/25' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/30' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/33' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/23' 2024-04-26T18:02:01.886 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/35' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/26' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './202/37' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './202' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/21' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/27' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/31' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/36' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/20' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/39' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/34' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/38' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/28' 2024-04-26T18:02:01.887 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/24' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/29' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/32' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/22' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/25' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/30' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/33' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/23' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/35' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/26' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './203/37' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './203' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/21' 2024-04-26T18:02:01.888 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/27' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/31' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/36' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/20' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/39' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/34' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/38' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/28' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/24' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/29' 2024-04-26T18:02:01.889 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/32' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/22' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/25' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/30' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/33' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/23' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/35' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/26' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './204/37' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './204' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/21' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/27' 2024-04-26T18:02:01.890 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/31' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/36' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/20' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/39' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/34' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/38' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/28' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/24' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/29' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/32' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/22' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/25' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/30' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/33' 2024-04-26T18:02:01.891 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/23' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/35' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/26' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './205/37' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './205' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/21' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/27' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/31' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/36' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/20' 2024-04-26T18:02:01.892 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/39' 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c1fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec200790 con 0x55cd20c1aae0 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec1ff670 con 0x55cd20bdb5e0 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec1f6700 con 0x55cd20bdcb40 2024-04-26T18:02:01.898 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8ebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8ebfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44280/0 (socket says 172.21.15.12:44280) 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8ebfff640 1 -- 172.21.15.12:0/3938855528 learned_addr learned my addr 172.21.15.12:0/3938855528 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.875+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c1fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 -- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 msgr2=0x55cd20c1fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c1fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 -- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 msgr2=0x55cd20bd51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 -- 172.21.15.12:0/3938855528 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd20c05a30 con 0x55cd20c1aae0 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c1fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:01.899 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa8e402ad70 tx=0x7fa8e402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57219452de9cb8f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8d0ff9640 1 -- 172.21.15.12:0/3938855528 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4037040 con 0x55cd20c1aae0 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8d0ff9640 1 -- 172.21.15.12:0/3938855528 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4007ac0 con 0x55cd20c1aae0 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.876+0000 7fa8d0ff9640 1 -- 172.21.15.12:0/3938855528 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4032440 con 0x55cd20c1aae0 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3938855528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 msgr2=0x55cd20c20050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa8e402ad70 tx=0x7fa8e402c000 comp rx=0 tx=0).stop 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3938855528 shutdown_connections 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20c1aae0 0x55cd20c20050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdcb40 0x55cd20c1fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/3938855528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20bdb5e0 0x55cd20bd51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3938855528 >> 172.21.15.12:0/3938855528 conn(0x55cd20ba2740 msgr2=0x55cd20c02f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3938855528 shutdown_connections 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/3938855528 wait complete. 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 -- start start 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.877+0000 7fa8f4fbc740 1 Processor -- start 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdb5e0 0x55cd20bdbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c945b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec1fe220 con 0x55cd20bdcb40 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec1fefa0 con 0x55cd20c1aae0 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec1fe8d0 con 0x55cd20bdb5e0 2024-04-26T18:02:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8f4fbc740 10 client.0 _ll_register_callbacks cb 0x7fa8e0017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44284/0 (socket says 172.21.15.12:44284) 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 -- 172.21.15.12:0/768308531 learned_addr learned my addr 172.21.15.12:0/768308531 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdb5e0 0x55cd20bdbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8ebfff640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c945b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 -- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdb5e0 msgr2=0x55cd20bdbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdb5e0 0x55cd20bdbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 -- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 msgr2=0x55cd20c945b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.878+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c945b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8eaffd640 1 -- 172.21.15.12:0/768308531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd20c12c00 con 0x55cd20bdcb40 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8eaffd640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000c00 tx=0x7fa8e0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3421262008531a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:01.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0005e60 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7fa8e0006720 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8e4007ac0 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fa8e0023450 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 10 client.4920 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd20c2da20 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4007ac0 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fa8e0036050 con 0x55cd20bdcb40 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 10 client.4920 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 10 client.4920 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:01.903 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 20 client.4920 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c94af0 0x55cd20c1d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 4 client.4920 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x55cd20b46800 con 0x55cd20c94af0 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.879+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c94af0 0x55cd20c1d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.880+0000 7fa8eb7fe640 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c94af0 0x55cd20c1d840 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f957cc5800f733a server_cookie=f3e66f296b822ad0 in_seq=0 out_seq=0 2024-04-26T18:02:01.904 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:01.880+0000 7fa8ca7fc640 10 client.4920 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:06.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8ca7fc640 1 -- 172.21.15.12:0/768308531 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cd20b46800 con 0x55cd20c94af0 2024-04-26T18:02:06.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8ca7fc640 10 client.4920 handle_command_reply: tid=0 2024-04-26T18:02:06.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 client.4920 shutdown 2024-04-26T18:02:06.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 msgr2=0x55cd20bfeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:06.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8e0000c00 tx=0x7fa8e0007ec0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 shutdown_connections 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd20c94af0 0x55cd20c1d840 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd20c1aae0 0x55cd20c945b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd20bdcb40 0x55cd20bfeee0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8ca7fc640 0 client.4920 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 --2- 172.21.15.12:0/768308531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd20bdb5e0 0x55cd20bdbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 >> 172.21.15.12:0/768308531 conn(0x55cd20ba2740 msgr2=0x55cd20c1f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 shutdown_connections 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.456+0000 7fa8f4fbc740 1 -- 172.21.15.12:0/768308531 wait complete. 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f4fbc740 20 client.4920 trim_cache size 0 max 16384 2024-04-26T18:02:06.457 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 10, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "a0da6531": { 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 10, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:02:06.458 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 79.5, 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:06.459 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 msgr2=0x7fa8d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 0x7fa8d806edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec154f00 tx=0x7fa8e0007b80 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 msgr2=0x7fa8ec1f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc00c450 tx=0x7fa8dc00c910 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 shutdown_connections 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa8d806c8f0 0x7fa8d806edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa8ec155e20 0x7fa8ec157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8ec0c6900 0x7fa8ec14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 --2- 172.21.15.12:0/1470412182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8ec0c64b0 0x7fa8ec1f2f80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:06.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.457+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 >> 172.21.15.12:0/1470412182 conn(0x7fa8ec072930 msgr2=0x7fa8ec0d1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.458+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 shutdown_connections 2024-04-26T18:02:06.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:06.458+0000 7fa8f21bf640 1 -- 172.21.15.12:0/1470412182 wait complete. 2024-04-26T18:02:06.472 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a0da6531', quiesce took 5.1 seconds. Will release after: 19.5 2024-04-26T18:02:14.677 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:14.680 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:25.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.088+0000 7f9355cbd640 1 Processor -- start 2024-04-26T18:02:26.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.088+0000 7f9355cbd640 1 -- start start 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9350155da0 0x7f935015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9350156180 0x7f93500d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f935015cbc0 con 0x7f9350155da0 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f93500cc730 con 0x7f9350156180 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f9355cbd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f935015f2a0 con 0x7f93500cd840 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f934f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9350155da0 0x7f935015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f934f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9350155da0 0x7f935015c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45120/0 (socket says 172.21.15.12:45120) 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.089+0000 7f934f7fe640 1 -- 172.21.15.12:0/27964530 learned_addr learned my addr 172.21.15.12:0/27964530 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934effd640 1 --2- 172.21.15.12:0/27964530 >> v2:172.21.15.100:3300/0 conn(0x7f9350156180 0x7f93500d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934ffff640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934f7fe640 1 -- 172.21.15.12:0/27964530 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 msgr2=0x7f93500d1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934f7fe640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934f7fe640 1 -- 172.21.15.12:0/27964530 >> v2:172.21.15.100:3300/0 conn(0x7f9350156180 msgr2=0x7f93500d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934f7fe640 1 --2- 172.21.15.12:0/27964530 >> v2:172.21.15.100:3300/0 conn(0x7f9350156180 0x7f93500d12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934f7fe640 1 -- 172.21.15.12:0/27964530 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935015f580 con 0x7f9350155da0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.090+0000 7f934ffff640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f934f7fe640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9350155da0 0x7f935015c680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93500cbe80 tx=0x7f934002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ded7c05ed1dae8e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f934e7fc640 1 -- 172.21.15.12:0/27964530 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340037070 con 0x7f9350155da0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f934e7fc640 1 -- 172.21.15.12:0/27964530 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9340032440 con 0x7f9350155da0 2024-04-26T18:02:26.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f934e7fc640 1 -- 172.21.15.12:0/27964530 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9340032810 con 0x7f9350155da0 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 -- 172.21.15.12:0/27964530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9350155da0 msgr2=0x7f935015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9350155da0 0x7f935015c680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93500cbe80 tx=0x7f934002a140 comp rx=0 tx=0).stop 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 -- 172.21.15.12:0/27964530 shutdown_connections 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 --2- 172.21.15.12:0/27964530 >> v2:172.21.15.100:3300/0 conn(0x7f9350156180 0x7f93500d12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 --2- 172.21.15.12:0/27964530 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9350155da0 0x7f935015c680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 -- 172.21.15.12:0/27964530 >> 172.21.15.12:0/27964530 conn(0x7f9350068090 msgr2=0x7f93500684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 -- 172.21.15.12:0/27964530 shutdown_connections 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.091+0000 7f9355cbd640 1 -- 172.21.15.12:0/27964530 wait complete. 2024-04-26T18:02:26.094 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 Processor -- start 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 -- start start 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 0x7f93500c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.093+0000 7f9355cbd640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f93500cc160 con 0x7f935015d600 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9355cbd640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f935015fb40 con 0x7f9350155da0 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9355cbd640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f93500cc2e0 con 0x7f93500cd840 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45130/0 (socket says 172.21.15.12:45130) 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 -- 172.21.15.12:0/310589394 learned_addr learned my addr 172.21.15.12:0/310589394 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934effd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 0x7f93500c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934f7fe640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 -- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 msgr2=0x7f93500d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 -- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 msgr2=0x7f93500c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 0x7f93500c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 -- 172.21.15.12:0/310589394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93500d0a70 con 0x7f935015d600 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934effd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 0x7f93500c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f934ffff640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9348007df0 tx=0x7f934800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934801a070 con 0x7f935015d600 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9348003990 con 0x7f935015d600 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935015ebd0 con 0x7f935015d600 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.094+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348003d80 con 0x7f935015d600 2024-04-26T18:02:26.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.095+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93501e63b0 con 0x7f935015d600 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.096+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9350076d20 con 0x7f935015d600 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.096+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f934801d070 con 0x7f935015d600 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.096+0000 7f9337fff640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 0x7f933c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.096+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f934808c0e0 con 0x7f935015d600 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.097+0000 7f934f7fe640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 0x7f933c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.097+0000 7f934f7fe640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 0x7f933c06ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9340034000 tx=0x7f934002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.101+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9348010070 con 0x7f935015d600 2024-04-26T18:02:26.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.324+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93500cd330 con 0x7f935015d600 2024-04-26T18:02:26.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.325+0000 7f9337fff640 1 -- 172.21.15.12:0/310589394 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f9348059a10 con 0x7f935015d600 2024-04-26T18:02:26.324 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:02:26.324 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:02:26.325 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 msgr2=0x7f933c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 0x7f933c06ede0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9340034000 tx=0x7f934002e000 comp rx=0 tx=0).stop 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 msgr2=0x7f93501e7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9348007df0 tx=0x7f934800d4a0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 shutdown_connections 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f935015d600 0x7f93501e7940 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9350155da0 0x7f93500c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f933c06c920 0x7f933c06ede0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 --2- 172.21.15.12:0/310589394 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93500cd840 0x7f93500d0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 >> 172.21.15.12:0/310589394 conn(0x7f9350068090 msgr2=0x7f9350150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 shutdown_connections 2024-04-26T18:02:26.327 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.327+0000 7f9355cbd640 1 -- 172.21.15.12:0/310589394 wait complete. 2024-04-26T18:02:26.337 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id a0da6531 --release --await' 2024-04-26T18:02:26.337 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id a0da6531 --release --await 2024-04-26T18:02:26.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.445+0000 7f3678c93640 1 Processor -- start 2024-04-26T18:02:26.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.445+0000 7f3678c93640 1 -- start start 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3678c93640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36740d18f0 0x7f367415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3678c93640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3678c93640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36740ce5e0 con 0x7f36740d1510 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3678c93640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f36740ce8c0 con 0x7f36740d18f0 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3678c93640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36740ceba0 con 0x7f36740cd620 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f366bfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36740d18f0 0x7f367415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.446 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f367259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f36740d1510 0x7f36740cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33256/0 (socket says 172.21.15.12:33256) 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f367259c640 1 -- 172.21.15.12:0/2641912024 learned_addr learned my addr 172.21.15.12:0/2641912024 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3672d9d640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f366bfff640 1 -- 172.21.15.12:0/2641912024 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 msgr2=0x7f36740c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f366bfff640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f366bfff640 1 -- 172.21.15.12:0/2641912024 >> v1:172.21.15.12:6789/0 conn(0x7f36740d1510 legacy=0x7f36740cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f3671d9b640 1 -- 172.21.15.12:0/2641912024 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96771092 0 0) 0x7f36740ce5e0 con 0x7f36740d1510 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.446+0000 7f366bfff640 1 -- 172.21.15.12:0/2641912024 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367415f100 con 0x7f36740d18f0 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.447+0000 7f366bfff640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f367415fbe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f365c0097a0 tx=0x7f365c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df36f8c2a73326d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.447+0000 7f3671d9b640 1 -- 172.21.15.12:0/2641912024 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c037070 con 0x7f36740d18f0 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.447+0000 7f3671d9b640 1 -- 172.21.15.12:0/2641912024 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c032440 con 0x7f36740d18f0 2024-04-26T18:02:26.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.447+0000 7f3671d9b640 1 -- 172.21.15.12:0/2641912024 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c032810 con 0x7f36740d18f0 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 -- 172.21.15.12:0/2641912024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 msgr2=0x7f367415fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f367415fbe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f365c0097a0 tx=0x7f365c02a210 comp rx=0 tx=0).stop 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 -- 172.21.15.12:0/2641912024 shutdown_connections 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 --2- 172.21.15.12:0/2641912024 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f367415fbe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 -- 172.21.15.12:0/2641912024 >> 172.21.15.12:0/2641912024 conn(0x7f3674072930 msgr2=0x7f3674072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 -- 172.21.15.12:0/2641912024 shutdown_connections 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.448+0000 7f3678c93640 1 -- 172.21.15.12:0/2641912024 wait complete. 2024-04-26T18:02:26.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.449+0000 7f3678c93640 1 Processor -- start 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.449+0000 7f3678c93640 1 -- start start 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36740d1510 0x7f36741f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36740ccc70 con 0x7f36740d18f0 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f367415f6c0 con 0x7f36740d1510 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3678c93640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3674155860 con 0x7f36740cd620 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45154/0 (socket says 172.21.15.12:45154) 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 -- 172.21.15.12:0/3900292236 learned_addr learned my addr 172.21.15.12:0/3900292236 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f367259c640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f366bfff640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36740d1510 0x7f36741f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 -- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 msgr2=0x7f36740c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 -- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36740d1510 msgr2=0x7f36741f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36740d1510 0x7f36741f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 -- 172.21.15.12:0/3900292236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f367414d320 con 0x7f36740d18f0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.450+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f366c007e40 tx=0x7f366c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.451+0000 7f366affd640 1 -- 172.21.15.12:0/3900292236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c014620 con 0x7f36740d18f0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.451+0000 7f366affd640 1 -- 172.21.15.12:0/3900292236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c019070 con 0x7f36740d18f0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.451+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f367414d5c0 con 0x7f36740d18f0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.451+0000 7f366affd640 1 -- 172.21.15.12:0/3900292236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c014a20 con 0x7f36740d18f0 2024-04-26T18:02:26.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.451+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36741f5080 con 0x7f36740d18f0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.452+0000 7f366affd640 1 -- 172.21.15.12:0/3900292236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f366c014bc0 con 0x7f36740d18f0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.453+0000 7f366affd640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.453+0000 7f366affd640 1 -- 172.21.15.12:0/3900292236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f366c08c760 con 0x7f36740d18f0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.453+0000 7f367259c640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.454+0000 7f367259c640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 0x7f365406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3664000f60 tx=0x7f3664007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.454+0000 7f367b9b1740 1 Processor -- start 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.454+0000 7f367b9b1740 1 -- start start 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087913470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0878d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a087839040 con 0x55a0878d5a10 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a0877d4b60 con 0x55a0878d44b0 2024-04-26T18:02:26.455 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55a087835000 con 0x55a0879139b0 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45158/0 (socket says 172.21.15.12:45158) 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 -- 172.21.15.12:0/3462419384 learned_addr learned my addr 172.21.15.12:0/3462419384 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f367259c640 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087913470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f366bfff640 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0878d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 -- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 msgr2=0x55a0878d4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0878d4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 -- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 msgr2=0x55a087913470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087913470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 -- 172.21.15.12:0/3462419384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0877c99c0 con 0x55a0878d5a10 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3672d9d640 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f366c062720 tx=0x7f366c05a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85301b1a1df0ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3653fff640 1 -- 172.21.15.12:0/3462419384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c058420 con 0x55a0878d5a10 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3653fff640 1 -- 172.21.15.12:0/3462419384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c056790 con 0x55a0878d5a10 2024-04-26T18:02:26.456 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.455+0000 7f3653fff640 1 -- 172.21.15.12:0/3462419384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c05e220 con 0x55a0878d5a10 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 -- 172.21.15.12:0/3462419384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 msgr2=0x55a0878d4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f366c062720 tx=0x7f366c05a1e0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 -- 172.21.15.12:0/3462419384 shutdown_connections 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0878d4dd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0878d4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 --2- 172.21.15.12:0/3462419384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087913470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 -- 172.21.15.12:0/3462419384 >> 172.21.15.12:0/3462419384 conn(0x55a08789b930 msgr2=0x55a087918450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 -- 172.21.15.12:0/3462419384 shutdown_connections 2024-04-26T18:02:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.456+0000 7f367b9b1740 1 -- 172.21.15.12:0/3462419384 wait complete. 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.457+0000 7f367b9b1740 1 -- start start 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.457+0000 7f367b9b1740 1 Processor -- start 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087926900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0879288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a0878d2af0 con 0x55a0878d5a10 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a0877d24f0 con 0x55a0878d44b0 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55a0878d6040 con 0x55a0879139b0 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367b9b1740 10 client.0 _ll_register_callbacks cb 0x55a08782fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45172/0 (socket says 172.21.15.12:45172) 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 -- 172.21.15.12:0/4197970855 learned_addr learned my addr 172.21.15.12:0/4197970855 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f3672d9d640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0879288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f367259c640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087926900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 -- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 msgr2=0x55a0879288f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0879288f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 -- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 msgr2=0x55a087926900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087926900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 -- 172.21.15.12:0/4197970855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a08754a920 con 0x55a0878d5a10 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f366bfff640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f365c000c00 tx=0x7f365c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb24e982dc2d4c34 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.458+0000 7f36517fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c037040 con 0x55a0878d5a10 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f365c046410 con 0x55a0878d5a10 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f366c056790 con 0x55a0878d5a10 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f365c04e050 con 0x55a0878d5a10 2024-04-26T18:02:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 10 client.4941 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a087616d30 con 0x55a0878d5a10 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c056790 con 0x55a0878d5a10 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f365c051020 con 0x55a0878d5a10 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 10 client.4941 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 10 client.4941 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 20 client.4941 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a0878fc100 0x55a087932470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 4 client.4941 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a08780ca00 con 0x55a0878fc100 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.459+0000 7f367259c640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a0878fc100 0x55a087932470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f367259c640 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a0878fc100 0x55a087932470 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b269adae266f027e server_cookie=63eba306768b221e in_seq=0 out_seq=0 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f36517fa640 10 client.4941 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f36517fa640 1 -- 172.21.15.12:0/4197970855 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a08780ca00 con 0x55a0878fc100 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f36517fa640 10 client.4941 handle_command_reply: tid=0 2024-04-26T18:02:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f367b9b1740 1 client.4941 shutdown 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 msgr2=0x55a0879283b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.460+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f365c000c00 tx=0x7f365c004730 comp rx=0 tx=0).stop 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 shutdown_connections 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a0879288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d5a10 0x55a0879283b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a0878fc100 0x55a087932470 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 --2- 172.21.15.12:0/4197970855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087926900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f36517fa640 0 client.4941 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 >> 172.21.15.12:0/4197970855 conn(0x55a08789b930 msgr2=0x55a0878ce6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 shutdown_connections 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 1 -- 172.21.15.12:0/4197970855 wait complete. 2024-04-26T18:02:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.461+0000 7f367b9b1740 20 client.4941 trim_cache size 0 max 16384 2024-04-26T18:02:26.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.478+0000 7f367b9b1740 1 Processor -- start 2024-04-26T18:02:26.477 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.478+0000 7f367b9b1740 1 -- start start 2024-04-26T18:02:26.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.478+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087927690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0878d5a10 0x55a0879374a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367b9b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3674200530 con 0x55a0879139b0 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36741ff410 con 0x55a0878d44b0 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36741fda50 con 0x55a0878d5a10 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45174/0 (socket says 172.21.15.12:45174) 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 -- 172.21.15.12:0/2985797384 learned_addr learned my addr 172.21.15.12:0/2985797384 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f367259c640 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087927690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f366bfff640 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0878d5a10 0x55a0879374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 -- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0878d5a10 msgr2=0x55a0879374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0878d5a10 0x55a0879374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 -- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 msgr2=0x55a087927690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087927690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 -- 172.21.15.12:0/2985797384 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a087927260 con 0x55a0879139b0 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f3672d9d640 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f366c08a8c0 tx=0x7f366c08c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df34559a4cf7a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f36537fe640 1 -- 172.21.15.12:0/2985797384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c058420 con 0x55a0879139b0 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f36537fe640 1 -- 172.21.15.12:0/2985797384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c077070 con 0x55a0879139b0 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.479+0000 7f36537fe640 1 -- 172.21.15.12:0/2985797384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c056790 con 0x55a0879139b0 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- 172.21.15.12:0/2985797384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 msgr2=0x55a0879379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f366c08a8c0 tx=0x7f366c08c000 comp rx=0 tx=0).stop 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- 172.21.15.12:0/2985797384 shutdown_connections 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0879139b0 0x55a0879379e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0878d5a10 0x55a0879374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2985797384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d44b0 0x55a087927690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- 172.21.15.12:0/2985797384 >> 172.21.15.12:0/2985797384 conn(0x55a08789b930 msgr2=0x55a0878feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- 172.21.15.12:0/2985797384 shutdown_connections 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- 172.21.15.12:0/2985797384 wait complete. 2024-04-26T18:02:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 -- start start 2024-04-26T18:02:26.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.480+0000 7f367b9b1740 1 Processor -- start 2024-04-26T18:02:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d5a10 0x55a087937ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a087988610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36741fdfa0 con 0x55a0878d44b0 2024-04-26T18:02:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f36741fed40 con 0x55a0878d5a10 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36741fe670 con 0x55a0879139b0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367b9b1740 10 client.0 _ll_register_callbacks cb 0x7f365c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45184/0 (socket says 172.21.15.12:45184) 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f367259c640 1 -- 172.21.15.12:0/2173956797 learned_addr learned my addr 172.21.15.12:0/2173956797 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f3672d9d640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a087988610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.481+0000 7f366bfff640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d5a10 0x55a087937ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 -- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 msgr2=0x55a087988610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a087988610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 -- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d5a10 msgr2=0x55a087937ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d5a10 0x55a087937ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 -- 172.21.15.12:0/2173956797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0878f8aa0 con 0x55a0878d44b0 2024-04-26T18:02:26.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367259c640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36640011e0 tx=0x7f3664012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b5f2f539ec2f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36640240d0 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f36640223f0 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f366c077070 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3664024270 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367b9b1740 10 client.4947 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a08798f200 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c077070 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.482+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3664038080 con 0x55a0878d44b0 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 10 client.4947 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 10 client.4947 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 20 client.4947 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a087937ff0 0x55a087988b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 4 client.4947 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a0da6531", "release": true, "await": true}] 2024-04-26T18:02:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a0da6531", "release": true, "await": true}) -- 0x55a087846c50 con 0x55a087937ff0 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f366bfff640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a087937ff0 0x55a087988b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f366bfff640 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a087937ff0 0x55a087988b50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc9191357f662f2c server_cookie=bb365ab3ee232141 in_seq=0 out_seq=0 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.483+0000 7f36517fa640 10 client.4947 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f36517fa640 1 -- 172.21.15.12:0/2173956797 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a087846c50 con 0x55a087937ff0 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f36517fa640 10 client.4947 handle_command_reply: tid=0 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 client.4947 shutdown 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 msgr2=0x55a08798eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36640011e0 tx=0x7f3664012000 comp rx=0 tx=0).stop 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 shutdown_connections 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a0879139b0 0x55a087988610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a087937ff0 0x55a087988b50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a0878d5a10 0x55a087937ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 --2- 172.21.15.12:0/2173956797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a0878d44b0 0x55a08798eab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 >> 172.21.15.12:0/2173956797 conn(0x55a08789b930 msgr2=0x55a0878fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f36517fa640 0 client.4947 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 shutdown_connections 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 1 -- 172.21.15.12:0/2173956797 wait complete. 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f367b9b1740 20 client.4947 trim_cache size 0 max 16384 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 12, 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "a0da6531": { 2024-04-26T18:02:26.489 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 12, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 79.5, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:26.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:26.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:26.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:26.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:26.491 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 msgr2=0x7f365406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 0x7f365406ede0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3664000f60 tx=0x7f3664007d50 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 msgr2=0x7f36741f1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.484+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f366c007e40 tx=0x7f366c00e4b0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 shutdown_connections 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36740d18f0 0x7f36741f1bd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36740d1510 0x7f36741f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f365406c920 0x7f365406ede0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 --2- 172.21.15.12:0/3900292236 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36740cd620 0x7f36740c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 >> 172.21.15.12:0/3900292236 conn(0x7f3674072930 msgr2=0x7f367414e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 shutdown_connections 2024-04-26T18:02:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.485+0000 7f3678c93640 1 -- 172.21.15.12:0/3900292236 wait complete. 2024-04-26T18:02:26.494 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a0da6531', seconds elapsed: 25.1 2024-04-26T18:02:26.494 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.5 2024-04-26T18:02:26.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.596+0000 7fedfe2fc640 1 Processor -- start 2024-04-26T18:02:26.596 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.596+0000 7fedfe2fc640 1 -- start start 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfe2fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 0x7fedf815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfe2fc640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fedf8156180 0x7fedf80d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfe2fc640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf815f2a0 con 0x7fedf80cd840 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfe2fc640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fedf815cbc0 con 0x7fedf8156180 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfe2fc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80cc730 con 0x7fedf8155da0 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfc899640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fedf80cd840 0x7fedf80c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33268/0 (socket says 172.21.15.12:33268) 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedfc899640 1 -- 172.21.15.12:0/153326531 learned_addr learned my addr 172.21.15.12:0/153326531 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedf77fe640 1 --2- 172.21.15.12:0/153326531 >> v2:172.21.15.100:3300/0 conn(0x7fedf8156180 0x7fedf80d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.598 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.597+0000 7fedf7fff640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 0x7fedf815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf6ffd640 1 -- 172.21.15.12:0/153326531 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496448921 0 0) 0x7fedf815f2a0 con 0x7fedf80cd840 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf6ffd640 1 -- 172.21.15.12:0/153326531 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede4003520 con 0x7fedf80cd840 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf77fe640 1 -- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 msgr2=0x7fedf815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf77fe640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 0x7fedf815c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf77fe640 1 -- 172.21.15.12:0/153326531 >> v1:172.21.15.12:6789/0 conn(0x7fedf80cd840 legacy=0x7fedf80c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf77fe640 1 -- 172.21.15.12:0/153326531 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf815f580 con 0x7fedf8156180 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf7fff640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 0x7fedf815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.598+0000 7fedf77fe640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8156180 0x7fedf80d12c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fede80097a0 tx=0x7fede802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a71764a9456aa96 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedf6ffd640 1 -- 172.21.15.12:0/153326531 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8037070 con 0x7fedf8156180 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedf6ffd640 1 -- 172.21.15.12:0/153326531 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede802ae50 con 0x7fedf8156180 2024-04-26T18:02:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedf6ffd640 1 -- 172.21.15.12:0/153326531 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede8032640 con 0x7fedf8156180 2024-04-26T18:02:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 -- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8156180 msgr2=0x7fedf80d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8156180 0x7fedf80d12c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fede80097a0 tx=0x7fede802a100 comp rx=0 tx=0).stop 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 -- 172.21.15.12:0/153326531 shutdown_connections 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8156180 0x7fedf80d12c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/153326531 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8155da0 0x7fedf815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 -- 172.21.15.12:0/153326531 >> 172.21.15.12:0/153326531 conn(0x7fedf8068090 msgr2=0x7fedf80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 -- 172.21.15.12:0/153326531 shutdown_connections 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.599+0000 7fedfe2fc640 1 -- 172.21.15.12:0/153326531 wait complete. 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.600+0000 7fedfe2fc640 1 Processor -- start 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 -- start start 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 0x7fedf81f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8153bc0 0x7fedf81f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fedf80c69b0 con 0x7fedf80cd840 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fedf815fb40 con 0x7fedf8155da0 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfe2fc640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fedf80c6b30 con 0x7fedf8153bc0 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedf7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedf77fe640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 0x7fedf81f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedf7fff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45190/0 (socket says 172.21.15.12:45190) 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedf7fff640 1 -- 172.21.15.12:0/743225000 learned_addr learned my addr 172.21.15.12:0/743225000 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.601+0000 7fedfc899640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8153bc0 0x7fedf81f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 -- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8153bc0 msgr2=0x7fedf81f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8153bc0 0x7fedf81f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 -- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 msgr2=0x7fedf81f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 0x7fedf81f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 -- 172.21.15.12:0/743225000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf815e320 con 0x7fedf80cd840 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf77fe640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 0x7fedf81f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf7fff640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fede000ebe0 tx=0x7fede000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0017070 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede000cc30 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf81f56b0 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede0013470 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.602+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf815e5e0 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.603+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf8076d20 con 0x7fedf80cd840 2024-04-26T18:02:26.605 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.604+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fede001a070 con 0x7fedf80cd840 2024-04-26T18:02:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.604+0000 7fedf4ff9640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 0x7fedd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.604+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7fede008bf00 con 0x7fedf80cd840 2024-04-26T18:02:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.604+0000 7fedf77fe640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 0x7fedd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.605+0000 7fedf77fe640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 0x7fedd806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fede8034000 tx=0x7fede802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.609+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fede0059830 con 0x7fedf80cd840 2024-04-26T18:02:26.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.839+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedf80cd330 con 0x7fedf80cd840 2024-04-26T18:02:26.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.840+0000 7fedf4ff9640 1 -- 172.21.15.12:0/743225000 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fede005db30 con 0x7fedf80cd840 2024-04-26T18:02:26.839 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:02:26.839 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:02:26.840 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 msgr2=0x7fedd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 0x7fedd806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fede8034000 tx=0x7fede802e000 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 msgr2=0x7fedf80cb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fede000ebe0 tx=0x7fede000c520 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 shutdown_connections 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fedd806c8f0 0x7fedd806edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fedf8153bc0 0x7fedf81f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedf8155da0 0x7fedf81f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 --2- 172.21.15.12:0/743225000 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedf80cd840 0x7fedf80cb030 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.842+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 >> 172.21.15.12:0/743225000 conn(0x7fedf8068090 msgr2=0x7fedf80c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.843+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 shutdown_connections 2024-04-26T18:02:26.842 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.843+0000 7fedfe2fc640 1 -- 172.21.15.12:0/743225000 wait complete. 2024-04-26T18:02:26.852 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0' 2024-04-26T18:02:26.852 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 79.5 --await-for 42.0 2024-04-26T18:02:26.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.963+0000 7f3e3159d640 1 Processor -- start 2024-04-26T18:02:26.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.963+0000 7f3e3159d640 1 -- start start 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e3159d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e2c156250 0x7f3e2c0cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e3159d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3e2c0cbf30 0x7f3e2c166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e3159d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2c0cb360 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e3159d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2c156630 con 0x7f3e2c156250 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e3159d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2c0cb100 con 0x7f3e2c0cbf30 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e2affd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e2c156250 0x7f3e2c0cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e2a7fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3e2c0c9d80 0x7f3e2c070100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33282/0 (socket says 172.21.15.12:33282) 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.964+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/3572971851 learned_addr learned my addr 172.21.15.12:0/3572971851 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/3572971851 >> v2:172.21.15.100:3300/0 conn(0x7f3e2c0cbf30 0x7f3e2c166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2affd640 1 -- 172.21.15.12:0/3572971851 >> v2:172.21.15.100:3300/0 conn(0x7f3e2c0cbf30 msgr2=0x7f3e2c166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2affd640 1 --2- 172.21.15.12:0/3572971851 >> v2:172.21.15.100:3300/0 conn(0x7f3e2c0cbf30 0x7f3e2c166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2affd640 1 -- 172.21.15.12:0/3572971851 >> v1:172.21.15.12:6789/0 conn(0x7f3e2c0c9d80 legacy=0x7f3e2c070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2affd640 1 -- 172.21.15.12:0/3572971851 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c0cbb90 con 0x7f3e2c156250 2024-04-26T18:02:26.965 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e29ffb640 1 -- 172.21.15.12:0/3572971851 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403217094 0 0) 0x7f3e2c0cb360 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.965+0000 7f3e2affd640 1 --2- 172.21.15.12:0/3572971851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c156250 0x7f3e2c0cabc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0ca360 tx=0x7f3e2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230b7e0782d0ebea server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.966 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e29ffb640 1 -- 172.21.15.12:0/3572971851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24037070 con 0x7f3e2c156250 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e29ffb640 1 -- 172.21.15.12:0/3572971851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24032440 con 0x7f3e2c156250 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e29ffb640 1 -- 172.21.15.12:0/3572971851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24032810 con 0x7f3e2c156250 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 -- 172.21.15.12:0/3572971851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c156250 msgr2=0x7f3e2c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 --2- 172.21.15.12:0/3572971851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c156250 0x7f3e2c0cabc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0ca360 tx=0x7f3e2402a1a0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 -- 172.21.15.12:0/3572971851 shutdown_connections 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 --2- 172.21.15.12:0/3572971851 >> v2:172.21.15.100:3300/0 conn(0x7f3e2c0cbf30 0x7f3e2c166710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 --2- 172.21.15.12:0/3572971851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c156250 0x7f3e2c0cabc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 -- 172.21.15.12:0/3572971851 >> 172.21.15.12:0/3572971851 conn(0x7f3e2c0746d0 msgr2=0x7f3e2c076100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 -- 172.21.15.12:0/3572971851 shutdown_connections 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.966+0000 7f3e3159d640 1 -- 172.21.15.12:0/3572971851 wait complete. 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.967+0000 7f3e3159d640 1 Processor -- start 2024-04-26T18:02:26.967 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 -- start start 2024-04-26T18:02:26.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 0x7f3e2c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 0x7f3e2c0b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c156250 0x7f3e2c0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.969 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c0ca6a0 con 0x7f3e2c0cbf30 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c0cb8b0 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e3159d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2c06e2d0 con 0x7f3e2c156250 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e2a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 0x7f3e2c0b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e2a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 0x7f3e2c0b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45220/0 (socket says 172.21.15.12:45220) 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e2affd640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 0x7f3e2c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/2962243248 learned_addr learned my addr 172.21.15.12:0/2962243248 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.968+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c156250 0x7f3e2c0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 -- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c156250 msgr2=0x7f3e2c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c156250 0x7f3e2c0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 -- 172.21.15.12:0/2962243248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 msgr2=0x7f3e2c0b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 0x7f3e2c0b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 -- 172.21.15.12:0/2962243248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1594c0 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.970 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 0x7f3e2c1f1550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0cf720 tx=0x7f3e240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e237fe640 1 -- 172.21.15.12:0/2962243248 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24041030 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e237fe640 1 -- 172.21.15.12:0/2962243248 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e24030500 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c158660 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e237fe640 1 -- 172.21.15.12:0/2962243248 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24037040 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.971 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.969+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c158c20 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.971+0000 7f3e237fe640 1 -- 172.21.15.12:0/2962243248 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e24044070 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.971+0000 7f3e237fe640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 0x7f3e0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.971+0000 7f3e237fe640 1 -- 172.21.15.12:0/2962243248 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f3e240ac540 con 0x7f3e2c0c9d80 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.971+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 0x7f3e0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.972+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 0x7f3e0c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c9c50 tx=0x7f3e14007e10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.972+0000 7f3e3438f740 1 Processor -- start 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.972+0000 7f3e3438f740 1 -- start start 2024-04-26T18:02:26.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff41df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41e0b40 0x563ff41dff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563ff4142d80 con 0x563ff41df5e0 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563ff40dec20 con 0x563ff421eae0 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x563ff413ed40 con 0x563ff41e0b40 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45222/0 (socket says 172.21.15.12:45222) 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 -- 172.21.15.12:0/2694219613 learned_addr learned my addr 172.21.15.12:0/2694219613 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff41df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41e0b40 0x563ff41dff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 -- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41e0b40 msgr2=0x563ff41dff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41e0b40 0x563ff41dff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 -- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 msgr2=0x563ff41df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff41df9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.973+0000 7f3e2affd640 1 -- 172.21.15.12:0/2694219613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff3f20d80 con 0x563ff41df5e0 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e240825a0 tx=0x7f3e240799c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2453770b360bb2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e20ff9640 1 -- 172.21.15.12:0/2694219613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24082ad0 con 0x563ff41df5e0 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e20ff9640 1 -- 172.21.15.12:0/2694219613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e240782a0 con 0x563ff41df5e0 2024-04-26T18:02:26.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e20ff9640 1 -- 172.21.15.12:0/2694219613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24082640 con 0x563ff41df5e0 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 -- 172.21.15.12:0/2694219613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 msgr2=0x563ff421e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3e240825a0 tx=0x7f3e240799c0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 -- 172.21.15.12:0/2694219613 shutdown_connections 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41e0b40 0x563ff41dff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff41df9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2694219613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41df5e0 0x563ff421e5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.974+0000 7f3e3438f740 1 -- 172.21.15.12:0/2694219613 >> 172.21.15.12:0/2694219613 conn(0x563ff41a6740 msgr2=0x563ff4223580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.975+0000 7f3e3438f740 1 -- 172.21.15.12:0/2694219613 shutdown_connections 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.975+0000 7f3e3438f740 1 -- 172.21.15.12:0/2694219613 wait complete. 2024-04-26T18:02:26.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.975+0000 7f3e3438f740 1 -- start start 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.975+0000 7f3e3438f740 1 Processor -- start 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4217420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff421c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563ff40dec20 con 0x563ff421eae0 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563ff40dc840 con 0x563ff41e0b40 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x563ff4142d80 con 0x563ff41df5e0 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e3438f740 10 client.0 _ll_register_callbacks cb 0x563ff40e05b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45238/0 (socket says 172.21.15.12:45238) 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/405851884 learned_addr learned my addr 172.21.15.12:0/405851884 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2affd640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4217420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff421c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 msgr2=0x563ff4217420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4217420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 msgr2=0x563ff421c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff421c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/405851884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff3f81510 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.976+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014db0 tx=0x7f3e1c012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3551eaa154bf312d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003b90 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f3e1c003d30 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e240782a0 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c004030 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 10 client.4968 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ff3e14670 con 0x563ff421eae0 2024-04-26T18:02:26.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e240782a0 con 0x563ff421eae0 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3e1c02a080 con 0x563ff421eae0 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 10 client.4968 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 10 client.4968 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 20 client.4968 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff4206f00 0x563ff4233070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 4 client.4968 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ff4150990 con 0x563ff4206f00 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.977+0000 7f3e2affd640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff4206f00 0x563ff4233070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e2affd640 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff4206f00 0x563ff4233070 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d16d6443877964 server_cookie=cd6930d0b46630f5 in_seq=0 out_seq=0 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e09ffb640 10 client.4968 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e09ffb640 1 -- 172.21.15.12:0/405851884 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x563ff4150990 con 0x563ff4206f00 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e09ffb640 10 client.4968 handle_command_reply: tid=0 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 client.4968 shutdown 2024-04-26T18:02:26.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 msgr2=0x563ff420a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c014db0 tx=0x7f3e1c012670 comp rx=0 tx=0).stop 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 shutdown_connections 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff420a020 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff4206f00 0x563ff4233070 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff421c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 --2- 172.21.15.12:0/405851884 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4217420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e09ffb640 0 client.4968 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.978+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 >> 172.21.15.12:0/405851884 conn(0x563ff41a6740 msgr2=0x563ff4208190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.979+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 shutdown_connections 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.979+0000 7f3e3438f740 1 -- 172.21.15.12:0/405851884 wait complete. 2024-04-26T18:02:26.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.979+0000 7f3e3438f740 20 client.4968 trim_cache size 0 max 16384 2024-04-26T18:02:26.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.996+0000 7f3e3438f740 1 Processor -- start 2024-04-26T18:02:26.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.996+0000 7f3e3438f740 1 -- start start 2024-04-26T18:02:26.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4243c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff41de4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563ff421e130 con 0x563ff421eae0 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c200530 con 0x563ff41e0b40 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2c1ff410 con 0x563ff41df5e0 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45244/0 (socket says 172.21.15.12:45244) 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/2280779266 learned_addr learned my addr 172.21.15.12:0/2280779266 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff41de4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2affd640 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4243c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 msgr2=0x563ff4243c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4243c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 msgr2=0x563ff41de4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff41de4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 -- 172.21.15.12:0/2280779266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ff4223900 con 0x563ff421eae0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c015010 tx=0x7f3e1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b49763dbabfaea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e0bfff640 1 -- 172.21.15.12:0/2280779266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0044c0 con 0x563ff421eae0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e0bfff640 1 -- 172.21.15.12:0/2280779266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c004660 con 0x563ff421eae0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.997+0000 7f3e0bfff640 1 -- 172.21.15.12:0/2280779266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003990 con 0x563ff421eae0 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- 172.21.15.12:0/2280779266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 msgr2=0x563ff4219a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c015010 tx=0x7f3e1c019000 comp rx=0 tx=0).stop 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- 172.21.15.12:0/2280779266 shutdown_connections 2024-04-26T18:02:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff421eae0 0x563ff4219a80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff41e0b40 0x563ff41de4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 --2- 172.21.15.12:0/2280779266 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4243c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- 172.21.15.12:0/2280779266 >> 172.21.15.12:0/2280779266 conn(0x563ff41a6740 msgr2=0x563ff41e0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- 172.21.15.12:0/2280779266 shutdown_connections 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- 172.21.15.12:0/2280779266 wait complete. 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 -- start start 2024-04-26T18:02:27.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.998+0000 7f3e3438f740 1 Processor -- start 2024-04-26T18:02:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4219c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff4293520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1fed40 con 0x563ff41e0b40 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1fd9b0 con 0x563ff421eae0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2c1fdfd0 con 0x563ff41df5e0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e3438f740 10 client.0 _ll_register_callbacks cb 0x7f3e1c009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e2a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e2a7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45260/0 (socket says 172.21.15.12:45260) 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/3978093504 learned_addr learned my addr 172.21.15.12:0/3978093504 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e2b7fe640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff4293520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:26.999+0000 7f3e2affd640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4219c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 msgr2=0x563ff4219c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4219c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 msgr2=0x563ff4293520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff4293520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 -- 172.21.15.12:0/3978093504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ff421bca0 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e2a7fc640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000f60 tx=0x7f3e14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264ef2d7f9176508 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14013b50 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f3e14013cf0 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e1c004660 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f3e14033050 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 10 client.4974 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563ff421c640 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c004660 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f3e1402d430 con 0x563ff41e0b40 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 10 client.4974 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:27.005 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 10 client.4974 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 20 client.4974 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff421f3a0 0x563ff4293a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 4 client.4974 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}] 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.000+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.5, "await_for": 42.0}) -- 0x563ff414a800 con 0x563ff421f3a0 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.001+0000 7f3e2affd640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff421f3a0 0x563ff4293a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.001+0000 7f3e09ffb640 10 client.4974 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:27.006 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:27.001+0000 7f3e2affd640 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff421f3a0 0x563ff4293a60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d7dd20888f3a87 server_cookie=bda095997cfb9a92 in_seq=0 out_seq=0 2024-04-26T18:02:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e09ffb640 1 -- 172.21.15.12:0/3978093504 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x563ff414a800 con 0x563ff421f3a0 2024-04-26T18:02:30.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e09ffb640 10 client.4974 handle_command_reply: tid=0 2024-04-26T18:02:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 client.4974 shutdown 2024-04-26T18:02:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 msgr2=0x563ff4216e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3e14000f60 tx=0x7f3e14000ed0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 shutdown_connections 2024-04-26T18:02:30.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x563ff421f3a0 0x563ff4293a60 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563ff421eae0 0x563ff4293520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563ff41e0b40 0x563ff4216e50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e09ffb640 0 client.4974 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 --2- 172.21.15.12:0/3978093504 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563ff41df5e0 0x563ff4219c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 >> 172.21.15.12:0/3978093504 conn(0x563ff41a6740 msgr2=0x563ff42179c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:30.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 shutdown_connections 2024-04-26T18:02:30.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 1 -- 172.21.15.12:0/3978093504 wait complete. 2024-04-26T18:02:30.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.120+0000 7f3e3438f740 20 client.4974 trim_cache size 0 max 16384 2024-04-26T18:02:30.124 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:02:30.125 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:02:30.125 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:02:30.125 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 14, 2024-04-26T18:02:30.125 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:02:30.125 INFO:teuthology.orchestra.run.smithi012.stdout: "369e6382": { 2024-04-26T18:02:30.126 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 14, 2024-04-26T18:02:30.126 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:02:30.126 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:30.126 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:02:30.126 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 79.5, 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:02:30.127 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:30.128 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:30.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:30.129 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:30.129 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:02:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 msgr2=0x7f3e0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 0x7f3e0c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0c9c50 tx=0x7f3e14007e10 comp rx=0 tx=0).stop 2024-04-26T18:02:30.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 msgr2=0x7f3e2c1f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 0x7f3e2c1f1550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c0cf720 tx=0x7f3e240046c0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 shutdown_connections 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f3e0c06c920 0x7f3e0c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3e2c156250 0x7f3e2c0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e2c0cbf30 0x7f3e2c0b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 --2- 172.21.15.12:0/2962243248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3e2c0c9d80 0x7f3e2c1f1550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:30.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 >> 172.21.15.12:0/2962243248 conn(0x7f3e2c0746d0 msgr2=0x7f3e2c0cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:30.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 shutdown_connections 2024-04-26T18:02:30.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:30.121+0000 7f3e3159d640 1 -- 172.21.15.12:0/2962243248 wait complete. 2024-04-26T18:02:30.135 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '369e6382', quiesce took 3.6 seconds. Will release after: 19.5 2024-04-26T18:02:44.739 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:44.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:02:49.637 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:02:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.752+0000 7fe327d6a640 1 Processor -- start 2024-04-26T18:02:49.753 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.753+0000 7fe327d6a640 1 -- start start 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.753+0000 7fe327d6a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe320156180 0x7fe32015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.753+0000 7fe327d6a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32015f2a0 con 0x7fe3200cd840 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.753+0000 7fe327d6a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe32015f580 con 0x7fe320155da0 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.753+0000 7fe327d6a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe32015cbc0 con 0x7fe320156180 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe326307640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3200cd840 0x7fe3200c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59270/0 (socket says 172.21.15.12:59270) 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe326307640 1 -- 172.21.15.12:0/2962105862 learned_addr learned my addr 172.21.15.12:0/2962105862 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> v2:172.21.15.100:3300/0 conn(0x7fe320156180 0x7fe32015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.757 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950003909 0 0) 0x7fe32015f2a0 con 0x7fe3200cd840 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe30c003520 con 0x7fe3200cd840 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218718368 0 0) 0x7fe30c003520 con 0x7fe3200cd840 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 >> v2:172.21.15.100:3300/0 conn(0x7fe320156180 msgr2=0x7fe32015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 --2- 172.21.15.12:0/2962105862 >> v2:172.21.15.100:3300/0 conn(0x7fe320156180 0x7fe32015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 >> v1:172.21.15.100:6789/0 conn(0x7fe320155da0 legacy=0x7fe3200d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe32015f860 con 0x7fe3200cd840 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fe31c0019f0 con 0x7fe3200cd840 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> v2:172.21.15.100:3300/0 conn(0x7fe320156180 0x7fe32015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 >> v1:172.21.15.12:6789/0 conn(0x7fe3200cd840 legacy=0x7fe3200c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c0039b0 0x7fe30c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 0x7fe30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe32015cbc0 con 0x7fe30c004800 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c00c160 con 0x7fe30c0039b0 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c00c360 con 0x7fe30c0051c0 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 0x7fe30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.754+0000 7fe325b06640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c0039b0 0x7fe30c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe326307640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 -- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe30c0051c0 msgr2=0x7fe30c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 -- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c0039b0 msgr2=0x7fe30c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c0039b0 0x7fe30c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 -- 172.21.15.12:0/2962105862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c003520 con 0x7fe30c004800 2024-04-26T18:02:49.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe326307640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe30c0051c0 0x7fe30c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe326307640 1 -- 172.21.15.12:0/2962105862 reap_dead start 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.755+0000 7fe325305640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 0x7fe30c004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe310009c60 tx=0x7fe30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e584e8315ee20a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe310009860 con 0x7fe30c004800 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe310004020 con 0x7fe30c004800 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe324b04640 1 -- 172.21.15.12:0/2962105862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3100043f0 con 0x7fe30c004800 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 -- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 msgr2=0x7fe30c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 0x7fe30c004c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe310009c60 tx=0x7fe30c005830 comp rx=0 tx=0).stop 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 -- 172.21.15.12:0/2962105862 shutdown_connections 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 --2- 172.21.15.12:0/2962105862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c004800 0x7fe30c004c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 -- 172.21.15.12:0/2962105862 >> 172.21.15.12:0/2962105862 conn(0x7fe320068090 msgr2=0x7fe3200684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:49.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 -- 172.21.15.12:0/2962105862 shutdown_connections 2024-04-26T18:02:49.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.756+0000 7fe327d6a640 1 -- 172.21.15.12:0/2962105862 wait complete. 2024-04-26T18:02:49.764 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.757+0000 7fe327d6a640 1 Processor -- start 2024-04-26T18:02:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 -- start start 2024-04-26T18:02:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c004800 0x7fe3201f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe32015a8b0 0x7fe32014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.765 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe3200cc160 con 0x7fe3201f2be0 2024-04-26T18:02:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe3200cc730 con 0x7fe30c004800 2024-04-26T18:02:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe327d6a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe3200cc2e0 con 0x7fe32015a8b0 2024-04-26T18:02:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe326307640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe325b06640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c004800 0x7fe3201f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe326307640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57650/0 (socket says 172.21.15.12:57650) 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe326307640 1 -- 172.21.15.12:0/3696025499 learned_addr learned my addr 172.21.15.12:0/3696025499 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.758+0000 7fe325305640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe32015a8b0 0x7fe32014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 -- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe32015a8b0 msgr2=0x7fe32014e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe32015a8b0 0x7fe32014e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 -- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c004800 msgr2=0x7fe3201f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c004800 0x7fe3201f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 -- 172.21.15.12:0/3696025499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3201f2700 con 0x7fe3201f2be0 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe326307640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe3200d2120 tx=0x7fe31c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00eb30 con 0x7fe3201f2be0 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe31c018070 con 0x7fe3201f2be0 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe32014e640 con 0x7fe3201f2be0 2024-04-26T18:02:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe31c013420 con 0x7fe3201f2be0 2024-04-26T18:02:49.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.759+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe32014d660 con 0x7fe3201f2be0 2024-04-26T18:02:49.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.760+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe320076d20 con 0x7fe3201f2be0 2024-04-26T18:02:49.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.761+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe31c0135c0 con 0x7fe3201f2be0 2024-04-26T18:02:49.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.761+0000 7fe3167fc640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:49.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.761+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7fe31c08c140 con 0x7fe3201f2be0 2024-04-26T18:02:49.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.761+0000 7fe325b06640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:49.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.762+0000 7fe325b06640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 0x7fe30406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe318000c00 tx=0x7fe318009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:49.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.766+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe31c059b00 con 0x7fe3201f2be0 2024-04-26T18:02:49.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.990+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe32014fe20 con 0x7fe3201f2be0 2024-04-26T18:02:49.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.990+0000 7fe3167fc640 1 -- 172.21.15.12:0/3696025499 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fe31c05de00 con 0x7fe3201f2be0 2024-04-26T18:02:49.990 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:02:49.991 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:02:49.991 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:02:49.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 msgr2=0x7fe30406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 0x7fe30406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe318000c00 tx=0x7fe318009040 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 msgr2=0x7fe32014cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe3200d2120 tx=0x7fe31c00e530 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 shutdown_connections 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3201f2be0 0x7fe32014cbf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe30406c920 0x7fe30406ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe32015a8b0 0x7fe32014e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 --2- 172.21.15.12:0/3696025499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe30c004800 0x7fe3201f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 >> 172.21.15.12:0/3696025499 conn(0x7fe320068090 msgr2=0x7fe3200cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 shutdown_connections 2024-04-26T18:02:49.993 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:49.992+0000 7fe327d6a640 1 -- 172.21.15.12:0/3696025499 wait complete. 2024-04-26T18:02:50.003 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 369e6382 --release --await' 2024-04-26T18:02:50.003 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 369e6382 --release --await 2024-04-26T18:02:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.111+0000 7f9463a07640 1 Processor -- start 2024-04-26T18:02:50.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.111+0000 7f9463a07640 1 -- start start 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.111+0000 7f9463a07640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f945c0cd540 0x7f945c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.111+0000 7f9463a07640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9463a07640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945c0cde50 con 0x7f945c156020 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9463a07640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f945c15beb0 con 0x7f945c0cd540 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9463a07640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f945c156400 con 0x7f945c0cda00 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9461fa4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f945c0cd540 0x7f945c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9461fa4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:49948/0 (socket says 172.21.15.12:49948) 2024-04-26T18:02:50.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f94617a3640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f945c156020 0x7f945c073d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:57812/0 (socket says 172.21.15.12:57812) 2024-04-26T18:02:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9461fa4640 1 -- 172.21.15.12:0/215193011 learned_addr learned my addr 172.21.15.12:0/215193011 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f945c0cd540 0x7f945c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:53994/0 (socket says 172.21.15.12:53994) 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 -- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 msgr2=0x7f945c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 -- 172.21.15.12:0/215193011 >> v1:172.21.15.100:6789/0 conn(0x7f945c156020 legacy=0x7f945c073d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9460fa2640 1 -- 172.21.15.12:0/215193011 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0cce00 con 0x7f945c0cd540 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.112+0000 7f9461fa4640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:02:50.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.113+0000 7f9460fa2640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c0cd540 0x7f945c0cbde0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f944c0097a0 tx=0x7f944c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d08c424c0e9bc42 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.113+0000 7f9453fff640 1 -- 172.21.15.12:0/215193011 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c037070 con 0x7f945c0cd540 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.113+0000 7f9453fff640 1 -- 172.21.15.12:0/215193011 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c032440 con 0x7f945c0cd540 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.113+0000 7f9453fff640 1 -- 172.21.15.12:0/215193011 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c032810 con 0x7f945c0cd540 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 -- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c0cd540 msgr2=0x7f945c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c0cd540 0x7f945c0cbde0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f944c0097a0 tx=0x7f944c02a210 comp rx=0 tx=0).stop 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 -- 172.21.15.12:0/215193011 shutdown_connections 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c0cd540 0x7f945c0cbde0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 --2- 172.21.15.12:0/215193011 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 -- 172.21.15.12:0/215193011 >> 172.21.15.12:0/215193011 conn(0x7f945c0762e0 msgr2=0x7f945c072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 -- 172.21.15.12:0/215193011 shutdown_connections 2024-04-26T18:02:50.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.114+0000 7f9463a07640 1 -- 172.21.15.12:0/215193011 wait complete. 2024-04-26T18:02:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.115+0000 7f9463a07640 1 Processor -- start 2024-04-26T18:02:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.115+0000 7f9463a07640 1 -- start start 2024-04-26T18:02:50.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c156020 0x7f945c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f945c160190 con 0x7f945c0cd540 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f945c15feb0 con 0x7f945c156020 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f945c074480 con 0x7f945c0cda00 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57656/0 (socket says 172.21.15.12:57656) 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 -- 172.21.15.12:0/1883648966 learned_addr learned my addr 172.21.15.12:0/1883648966 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9461fa4640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c156020 0x7f945c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9460fa2640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 -- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 msgr2=0x7f945c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 -- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c156020 msgr2=0x7f945c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c156020 0x7f945c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 -- 172.21.15.12:0/1883648966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c1f2530 con 0x7f945c0cd540 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f94617a3640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f945800c400 tx=0x7f945800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9451ffb640 1 -- 172.21.15.12:0/1883648966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580074e0 con 0x7f945c0cd540 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9451ffb640 1 -- 172.21.15.12:0/1883648966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94580047e0 con 0x7f945c0cd540 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c1f27a0 con 0x7f945c0cd540 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.116+0000 7f9451ffb640 1 -- 172.21.15.12:0/1883648966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458004c10 con 0x7f945c0cd540 2024-04-26T18:02:50.119 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.117+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c15afa0 con 0x7f945c0cd540 2024-04-26T18:02:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.118+0000 7f9451ffb640 1 -- 172.21.15.12:0/1883648966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f945801a020 con 0x7f945c0cd540 2024-04-26T18:02:50.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.119+0000 7f9451ffb640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.119+0000 7f9451ffb640 1 -- 172.21.15.12:0/1883648966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f945808b850 con 0x7f945c0cd540 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.119+0000 7f9460fa2640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.119+0000 7f9460fa2640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 0x7f944006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f944c034000 tx=0x7f944c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 Processor -- start 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 -- start start 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01144b0 0x5575e0153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0114dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575e0079040 con 0x5575e01539b0 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5575e0014b60 con 0x5575e01144b0 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.120+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5575e0075000 con 0x5575e0115a10 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57670/0 (socket says 172.21.15.12:57670) 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 -- 172.21.15.12:0/617795975 learned_addr learned my addr 172.21.15.12:0/617795975 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f94617a3640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01144b0 0x5575e0153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9461fa4640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0114dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 -- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 msgr2=0x5575e0114dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0114dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 -- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01144b0 msgr2=0x5575e0153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01144b0 0x5575e0153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 -- 172.21.15.12:0/617795975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e00099c0 con 0x5575e01539b0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9461fa4640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9460fa2640 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f944c009560 tx=0x7f944c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db4c79dd86956dc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9446ffd640 1 -- 172.21.15.12:0/617795975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c04e070 con 0x5575e01539b0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9446ffd640 1 -- 172.21.15.12:0/617795975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c049470 con 0x5575e01539b0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.121+0000 7f9446ffd640 1 -- 172.21.15.12:0/617795975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c037040 con 0x5575e01539b0 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- 172.21.15.12:0/617795975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 msgr2=0x5575e0114890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f944c009560 tx=0x7f944c02c000 comp rx=0 tx=0).stop 2024-04-26T18:02:50.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- 172.21.15.12:0/617795975 shutdown_connections 2024-04-26T18:02:50.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0114dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01539b0 0x5575e0114890 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 --2- 172.21.15.12:0/617795975 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01144b0 0x5575e0153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- 172.21.15.12:0/617795975 >> 172.21.15.12:0/617795975 conn(0x5575e00db930 msgr2=0x5575e0158450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- 172.21.15.12:0/617795975 shutdown_connections 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- 172.21.15.12:0/617795975 wait complete. 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 -- start start 2024-04-26T18:02:50.126 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.122+0000 7f94667fb740 1 Processor -- start 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e01517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e013b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5575e0112af0 con 0x5575e0115a10 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5575e00124f0 con 0x5575e01539b0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5575e0116040 con 0x5575e01144b0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f94667fb740 10 client.0 _ll_register_callbacks cb 0x5575e006fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57684/0 (socket says 172.21.15.12:57684) 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.123+0000 7f9460fa2640 1 -- 172.21.15.12:0/4207207101 learned_addr learned my addr 172.21.15.12:0/4207207101 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9461fa4640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e013b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f94617a3640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e01517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 -- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 msgr2=0x5575e01517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e01517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 -- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 msgr2=0x5575e013b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e013b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 -- 172.21.15.12:0/4207207101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575dfd8a920 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f9460fa2640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a800 tx=0x7f944c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe83e95d129024bc server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f943bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c04e030 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f944c03ec00 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f944c049470 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f944c037040 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f94667fb740 10 client.4989 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5575dfe56d30 con 0x5575e0115a10 2024-04-26T18:02:50.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.124+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c049470 con 0x5575e0115a10 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f944c049620 con 0x5575e0115a10 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 10 client.4989 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 10 client.4989 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 20 client.4989 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e01543e0 0x5575e013bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 4 client.4989 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e004ca00 con 0x5575e01543e0 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94617a3640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e01543e0 0x5575e013bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f943bfff640 10 client.4989 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.125+0000 7f94617a3640 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e01543e0 0x5575e013bc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=335b05b4ec3bfd4c server_cookie=f483b05891521007 in_seq=0 out_seq=0 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f943bfff640 1 -- 172.21.15.12:0/4207207101 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5575e004ca00 con 0x5575e01543e0 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f943bfff640 10 client.4989 handle_command_reply: tid=0 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 client.4989 shutdown 2024-04-26T18:02:50.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 msgr2=0x5575e01681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a800 tx=0x7f944c004730 comp rx=0 tx=0).stop 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 shutdown_connections 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e01543e0 0x5575e013bc20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e013b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f943bfff640 0 client.4989 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e01681d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 --2- 172.21.15.12:0/4207207101 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e01517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 >> 172.21.15.12:0/4207207101 conn(0x5575e00db930 msgr2=0x5575e013cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 shutdown_connections 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 1 -- 172.21.15.12:0/4207207101 wait complete. 2024-04-26T18:02:50.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.126+0000 7f94667fb740 20 client.4989 trim_cache size 0 max 16384 2024-04-26T18:02:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.144+0000 7f94667fb740 1 Processor -- start 2024-04-26T18:02:50.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.144+0000 7f94667fb740 1 -- start start 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.144+0000 7f94667fb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.144+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e0152380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94667fb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f945c2006c0 con 0x5575e01144b0 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1ff5a0 con 0x5575e01539b0 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f945c1f5cc0 con 0x5575e0115a10 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57686/0 (socket says 172.21.15.12:57686) 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 -- 172.21.15.12:0/1772792278 learned_addr learned my addr 172.21.15.12:0/1772792278 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f9461fa4640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f9460fa2640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 -- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 msgr2=0x5575e0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 -- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 msgr2=0x5575e0152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e0152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 -- 172.21.15.12:0/1772792278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e0115450 con 0x5575e01144b0 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f9461fa4640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e0152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94617a3640 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f94580070a0 tx=0x7f9458089820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77c1b740bf01b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94467fc640 1 -- 172.21.15.12:0/1772792278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94580899d0 con 0x5575e01144b0 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94467fc640 1 -- 172.21.15.12:0/1772792278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94580573d0 con 0x5575e01144b0 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.145+0000 7f94467fc640 1 -- 172.21.15.12:0/1772792278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945805d0c0 con 0x5575e01144b0 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- 172.21.15.12:0/1772792278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 msgr2=0x5575e014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f94580070a0 tx=0x7f9458089820 comp rx=0 tx=0).stop 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- 172.21.15.12:0/1772792278 shutdown_connections 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e0152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e0115a10 0x5575e0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 --2- 172.21.15.12:0/1772792278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e01144b0 0x5575e014ec20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- 172.21.15.12:0/1772792278 >> 172.21.15.12:0/1772792278 conn(0x5575e00db930 msgr2=0x5575e0158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- 172.21.15.12:0/1772792278 shutdown_connections 2024-04-26T18:02:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- 172.21.15.12:0/1772792278 wait complete. 2024-04-26T18:02:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 -- start start 2024-04-26T18:02:50.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.146+0000 7f94667fb740 1 Processor -- start 2024-04-26T18:02:50.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e010f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e01cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1fe150 con 0x5575e0115a10 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1feed0 con 0x5575e01539b0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f945c1fe800 con 0x5575e01144b0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94667fb740 10 client.0 _ll_register_callbacks cb 0x7f944c04c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f9460fa2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57698/0 (socket says 172.21.15.12:57698) 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f9460fa2640 1 -- 172.21.15.12:0/2985328316 learned_addr learned my addr 172.21.15.12:0/2985328316 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f94617a3640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e010f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.147+0000 7f9461fa4640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e01cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 -- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 msgr2=0x5575e010f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e010f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 -- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 msgr2=0x5575e01cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e01cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 -- 172.21.15.12:0/2985328316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e0152550 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f9460fa2640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a250 tx=0x7f944c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd91f99efefa4e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c04e070 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 6763+0+0 (secure 0 0 0) 0x7f944c03ee00 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94580573d0 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f944c067050 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 10 client.4995 fetch_fsmap learned FSMap version 9 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5575e0178850 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94580573d0 con 0x5575e0115a10 2024-04-26T18:02:50.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f944c05e030 con 0x5575e0115a10 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 10 client.4995 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 10 client.4995 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 20 client.4995 populate_metadata read hostname 'smithi012' 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e0150850 0x5575e01cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 4 client.4995 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "369e6382", "release": true, "await": true}] 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.148+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "369e6382", "release": true, "await": true}) -- 0x5575e0086c50 con 0x5575e0150850 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f94617a3640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e0150850 0x5575e01cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f943bfff640 10 client.4995 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f94617a3640 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e0150850 0x5575e01cc7d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed6454baf65ff4b2 server_cookie=c47bd97c2c1a28a in_seq=0 out_seq=0 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f943bfff640 1 -- 172.21.15.12:0/2985328316 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5575e0086c50 con 0x5575e0150850 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f943bfff640 10 client.4995 handle_command_reply: tid=0 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f94667fb740 1 client.4995 shutdown 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 msgr2=0x5575e013d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.149+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f944c02a250 tx=0x7f944c008030 comp rx=0 tx=0).stop 2024-04-26T18:02:50.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 shutdown_connections 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5575e0150850 0x5575e01cc7d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5575e01539b0 0x5575e01cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5575e0115a10 0x5575e013d220 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 --2- 172.21.15.12:0/2985328316 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5575e01144b0 0x5575e010f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f943bfff640 0 client.4995 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 >> 172.21.15.12:0/2985328316 conn(0x5575e00db930 msgr2=0x5575e0151e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 shutdown_connections 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 1 -- 172.21.15.12:0/2985328316 wait complete. 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f94667fb740 20 client.4995 trim_cache size 0 max 16384 2024-04-26T18:02:50.156 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 16, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "369e6382": { 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 16, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 79.5, 2024-04-26T18:02:50.157 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:02:50.158 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 msgr2=0x7f944006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 0x7f944006edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f944c034000 tx=0x7f944c02e000 comp rx=0 tx=0).stop 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 msgr2=0x7f945c0b5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f945800c400 tx=0x7f945800c8c0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 shutdown_connections 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f945c156020 0x7f945c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f944006c8f0 0x7f944006edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f945c0cda00 0x7f945c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 --2- 172.21.15.12:0/1883648966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f945c0cd540 0x7f945c0b5c70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:02:50.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 >> 172.21.15.12:0/1883648966 conn(0x7f945c0762e0 msgr2=0x7f945c15c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:02:50.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 shutdown_connections 2024-04-26T18:02:50.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:02:50.150+0000 7f9463a07640 1 -- 172.21.15.12:0/1883648966 wait complete. 2024-04-26T18:02:50.161 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '369e6382', seconds elapsed: 23.7 2024-04-26T18:02:51.308 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/34' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/38' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/28' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/24' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/29' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/32' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/22' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/25' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/30' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/33' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/23' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/35' 2024-04-26T18:02:51.309 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/26' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './206/37' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './206' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/21' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/27' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/31' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/36' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/20' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/39' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/34' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/38' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/28' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/24' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/29' 2024-04-26T18:02:51.310 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/32' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/22' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/25' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/30' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/33' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/23' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/35' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/26' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './207/37' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './207' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/21' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/27' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/31' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/36' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/20' 2024-04-26T18:02:51.311 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/39' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/34' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/38' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/28' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/24' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/29' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/32' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/22' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/25' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/30' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/33' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/23' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/35' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/26' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed './208/37' 2024-04-26T18:02:51.312 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './208' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/21' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/27' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/31' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/36' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/20' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/39' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/34' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/38' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/28' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/24' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/29' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/32' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/22' 2024-04-26T18:02:51.313 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/25' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/30' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/33' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/23' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/35' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/26' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './209/37' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './209' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/21' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/27' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/31' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/36' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/20' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/39' 2024-04-26T18:02:51.314 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/34' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/38' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/28' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/24' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/29' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/32' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/22' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/25' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/30' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/33' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/23' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/35' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/26' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './210/37' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './210' 2024-04-26T18:02:51.315 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/21' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/27' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/31' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/36' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/20' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/39' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/34' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/38' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/28' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/24' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/29' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/32' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/22' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/25' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/30' 2024-04-26T18:02:51.316 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/33' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/23' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/35' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/26' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './211/37' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './211' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/21' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/27' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/31' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/36' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/20' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/39' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/34' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/38' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/28' 2024-04-26T18:02:51.317 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/24' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/29' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/32' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/22' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/25' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/30' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/33' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/23' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/35' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/26' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './212/37' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './212' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/21' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/27' 2024-04-26T18:02:51.318 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/31' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/36' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/20' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/39' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/34' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/38' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/28' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/24' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/29' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/32' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/22' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/25' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/30' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/33' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/23' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/35' 2024-04-26T18:02:51.319 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/26' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './213/37' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './213' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/21' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/27' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/31' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/36' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/20' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/39' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/34' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/38' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/28' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/24' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/29' 2024-04-26T18:02:51.320 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/32' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/22' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/25' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/30' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/33' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/23' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/35' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/26' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './214/37' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './214' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/21' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/27' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/31' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/36' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/20' 2024-04-26T18:02:51.321 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/39' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/34' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/38' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/28' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/24' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/29' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/32' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/22' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/25' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/30' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/33' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/23' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/35' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/26' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed './215/37' 2024-04-26T18:02:51.322 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './215' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/21' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/27' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/31' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/36' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/20' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/39' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/34' 2024-04-26T18:02:51.323 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/38' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/28' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/24' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/29' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/32' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/22' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/25' 2024-04-26T18:02:52.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/30' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/33' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/23' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/35' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/26' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './216/37' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './216' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/21' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/27' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/31' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/36' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/20' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/39' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/34' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/38' 2024-04-26T18:02:52.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/28' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/24' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/29' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/32' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/22' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/25' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/30' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/33' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/23' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/35' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/26' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './217/37' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './217' 2024-04-26T18:02:52.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/21' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/27' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/31' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/36' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/20' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/39' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/34' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/38' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/28' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/24' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/29' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/32' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/22' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/25' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/30' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/33' 2024-04-26T18:02:52.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/23' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/35' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/26' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './218/37' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './218' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/21' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/27' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/31' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/36' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/20' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/39' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/34' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/38' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/28' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/24' 2024-04-26T18:02:52.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/29' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/32' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/22' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/25' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/30' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/33' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/23' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/35' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/26' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './219/37' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './219' 2024-04-26T18:02:52.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/21' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/27' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/31' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/36' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/20' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/39' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/34' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/38' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/28' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/24' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/29' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/32' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/22' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/25' 2024-04-26T18:02:52.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/30' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/33' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/23' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/35' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/26' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './220/37' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './220' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/21' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/27' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/31' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/36' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/20' 2024-04-26T18:02:52.075 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/39' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/34' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/38' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/28' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/24' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/29' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/32' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/22' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/25' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/30' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/33' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/23' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/35' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/26' 2024-04-26T18:02:52.076 INFO:tasks.workunit.client.0.smithi012.stdout:removed './221/37' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './221' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/21' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/27' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/31' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/36' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/20' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/39' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/34' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/38' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/28' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/24' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/29' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/32' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/22' 2024-04-26T18:02:52.077 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/25' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/30' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/33' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/23' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/35' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/26' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './222/37' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './222' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/21' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/27' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/31' 2024-04-26T18:02:52.078 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/36' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/20' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/39' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/34' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/38' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/28' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/24' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/29' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/32' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/22' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/25' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/30' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/33' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/23' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/35' 2024-04-26T18:02:52.079 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/26' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './223/37' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './223' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/21' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/27' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/31' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/36' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/20' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/39' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/34' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/38' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/28' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/24' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/29' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/32' 2024-04-26T18:02:52.080 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/22' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/25' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/30' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/33' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/23' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/35' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/26' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './224/37' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './224' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/21' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/27' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/31' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/36' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/20' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/39' 2024-04-26T18:02:52.081 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/34' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/38' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/28' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/24' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/29' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/32' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/22' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/25' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/30' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/33' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/23' 2024-04-26T18:02:52.082 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/35' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/26' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './225/37' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './225' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/21' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/27' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/31' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/36' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/20' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/39' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/34' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/38' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/28' 2024-04-26T18:02:52.083 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/24' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/29' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/32' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/22' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/25' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/30' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/33' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/23' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/35' 2024-04-26T18:02:53.197 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/26' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './226/37' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './226' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/21' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/27' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/31' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/36' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/20' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/39' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/34' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/38' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/28' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/24' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/29' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/32' 2024-04-26T18:02:53.198 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/22' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/25' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/30' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/33' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/23' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/35' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/26' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './227/37' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './227' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/21' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/27' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/31' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/36' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/20' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/39' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/34' 2024-04-26T18:02:53.199 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/38' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/28' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/24' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/29' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/32' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/22' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/25' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/30' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/33' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/23' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/35' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/26' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './228/37' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './228' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/21' 2024-04-26T18:02:53.200 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/27' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/31' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/36' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/20' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/39' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/34' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/38' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/28' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/24' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/29' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/32' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/22' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/25' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/30' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/33' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/23' 2024-04-26T18:02:53.201 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/35' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/26' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './229/37' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './229' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/21' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/27' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/31' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/36' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/20' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/39' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/34' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/38' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/28' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/24' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/29' 2024-04-26T18:02:53.202 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/32' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/22' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/25' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/30' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/33' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/23' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/35' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/26' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './230/37' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './230' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/21' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/27' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/31' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/36' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/20' 2024-04-26T18:02:53.203 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/39' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/34' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/38' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/28' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/24' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/29' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/32' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/22' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/25' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/30' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/33' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/23' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/35' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/26' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './231/37' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './231' 2024-04-26T18:02:53.204 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/21' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/27' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/31' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/36' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/20' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/39' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/34' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/38' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/28' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/24' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/29' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/32' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/22' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/25' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/30' 2024-04-26T18:02:53.205 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/33' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/23' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/35' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/26' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './232/37' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './232' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/21' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/27' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/31' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/36' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/20' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/39' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/34' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/38' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/28' 2024-04-26T18:02:53.206 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/24' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/29' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/32' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/22' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/25' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/30' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/33' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/23' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/35' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/26' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './233/37' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './233' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/21' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/27' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/31' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/36' 2024-04-26T18:02:53.207 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/20' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/39' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/34' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/38' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/28' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/24' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/29' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/32' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/22' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/25' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/30' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/33' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/23' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/35' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/26' 2024-04-26T18:02:53.208 INFO:tasks.workunit.client.0.smithi012.stdout:removed './234/37' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './234' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/21' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/27' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/31' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/36' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/20' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/39' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/34' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/38' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/28' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/24' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/29' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/32' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/22' 2024-04-26T18:02:53.209 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/25' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/30' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/33' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/23' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/35' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/26' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './235/37' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './235' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/21' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/27' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/31' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/36' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/20' 2024-04-26T18:02:53.210 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/39' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/34' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/38' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/28' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/24' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/29' 2024-04-26T18:02:53.211 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/32' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/22' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/25' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/30' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/33' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/23' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/35' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/26' 2024-04-26T18:02:55.236 INFO:tasks.workunit.client.0.smithi012.stdout:removed './236/37' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './236' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/21' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/27' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/31' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/36' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/20' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/39' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/34' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/38' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/28' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/24' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/29' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/32' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/22' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/25' 2024-04-26T18:02:55.237 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/30' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/33' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/23' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/35' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/26' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './237/37' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './237' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/21' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/27' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/31' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/36' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/20' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/39' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/34' 2024-04-26T18:02:55.238 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/38' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/28' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/24' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/29' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/32' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/22' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/25' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/30' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/33' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/23' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/35' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/26' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './238/37' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './238' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/21' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/27' 2024-04-26T18:02:55.239 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/31' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/36' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/20' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/39' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/34' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/38' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/28' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/24' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/29' 2024-04-26T18:02:55.240 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/32' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/22' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/25' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/30' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/33' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/23' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/35' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/26' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './239/37' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './239' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/21' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/27' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/31' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/36' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/20' 2024-04-26T18:02:55.241 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/39' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/34' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/38' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/28' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/24' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/29' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/32' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/22' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/25' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/30' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/33' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/23' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/35' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/26' 2024-04-26T18:02:55.242 INFO:tasks.workunit.client.0.smithi012.stdout:removed './240/37' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './240' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/21' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/27' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/31' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/36' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/20' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/39' 2024-04-26T18:02:55.243 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/34' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/38' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/28' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/24' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/29' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/32' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/22' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/25' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/30' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/33' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/23' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/35' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/26' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './241/37' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './241' 2024-04-26T18:02:55.244 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/21' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/27' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/31' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/36' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/20' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/39' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/34' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/38' 2024-04-26T18:02:55.245 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/28' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/24' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/29' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/32' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/22' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/25' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/30' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/33' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/23' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/35' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/26' 2024-04-26T18:02:55.246 INFO:tasks.workunit.client.0.smithi012.stdout:removed './242/37' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './242' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/21' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/27' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/31' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/36' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/20' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/39' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/34' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/38' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/28' 2024-04-26T18:02:55.247 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/24' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/29' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/32' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/22' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/25' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/30' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/33' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/23' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/35' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/26' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './243/37' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './243' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/21' 2024-04-26T18:02:55.248 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/27' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/31' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/36' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/20' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/39' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/34' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/38' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/28' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/24' 2024-04-26T18:02:55.249 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/29' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/32' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/22' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/25' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/30' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/33' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/23' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/35' 2024-04-26T18:02:55.250 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/26' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './244/37' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './244' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/21' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/27' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/31' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/36' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/20' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/39' 2024-04-26T18:02:55.251 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/34' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/38' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/28' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/24' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/29' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/32' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/22' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/25' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/30' 2024-04-26T18:02:55.252 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/33' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/23' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/35' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/26' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './245/37' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './245' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/21' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/27' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/31' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/36' 2024-04-26T18:02:55.253 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/20' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/39' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/34' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/38' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/28' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/24' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/29' 2024-04-26T18:02:55.254 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/32' 2024-04-26T18:02:55.255 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/22' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/25' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/30' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/33' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/23' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/35' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/26' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './246/37' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './246' 2024-04-26T18:02:57.212 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/21' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/27' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/31' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/36' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/20' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/39' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/34' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/38' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/28' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/24' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/29' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/32' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/22' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/25' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/30' 2024-04-26T18:02:57.213 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/33' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/23' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/35' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/26' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './247/37' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './247' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/21' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/27' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/31' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/36' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/20' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/39' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/34' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/38' 2024-04-26T18:02:57.214 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/28' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/24' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/29' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/32' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/22' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/25' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/30' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/33' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/23' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/35' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/26' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './248/37' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './248' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/21' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/27' 2024-04-26T18:02:57.215 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/31' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/36' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/20' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/39' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/34' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/38' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/28' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/24' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/29' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/32' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/22' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/25' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/30' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/33' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/23' 2024-04-26T18:02:57.216 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/35' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/26' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './249/37' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './249' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/21' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/27' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/31' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/36' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/20' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/39' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/34' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/38' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/28' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/24' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/29' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/32' 2024-04-26T18:02:57.217 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/22' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/25' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/30' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/33' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/23' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/35' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/26' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './250/37' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './250' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/21' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/27' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/31' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/36' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/20' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/39' 2024-04-26T18:02:57.218 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/34' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/38' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/28' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/24' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/29' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/32' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/22' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/25' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/30' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/33' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/23' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/35' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/26' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './251/37' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './251' 2024-04-26T18:02:57.219 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/21' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/27' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/31' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/36' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/20' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/39' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/34' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/38' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/28' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/24' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/29' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/32' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/22' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/25' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/30' 2024-04-26T18:02:57.220 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/33' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/23' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/35' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/26' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './252/37' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './252' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/21' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/27' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/31' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/36' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/20' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/39' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/34' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/38' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/28' 2024-04-26T18:02:57.221 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/24' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/29' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/32' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/22' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/25' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/30' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/33' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/23' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/35' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/26' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './253/37' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './253' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/21' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/27' 2024-04-26T18:02:57.222 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/31' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/36' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/20' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/39' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/34' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/38' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/28' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/24' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/29' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/32' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/22' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/25' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/30' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/33' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/23' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/35' 2024-04-26T18:02:57.223 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/26' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './254/37' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './254' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/21' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/27' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/31' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/36' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/20' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/39' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/34' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/38' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/28' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/24' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/29' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/32' 2024-04-26T18:02:57.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/22' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/25' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/30' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/33' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/23' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/35' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/26' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './255/37' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './255' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/21' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/27' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/31' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/36' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/20' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/39' 2024-04-26T18:02:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/34' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/38' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/28' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/24' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/29' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/32' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/22' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/25' 2024-04-26T18:02:57.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/30' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/33' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/23' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/35' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/26' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './256/37' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './256' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/21' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/27' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/31' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/36' 2024-04-26T18:02:59.645 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/20' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/39' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/34' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/38' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/28' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/24' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/29' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/32' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/22' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/25' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/30' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/33' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/23' 2024-04-26T18:02:59.646 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/35' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/26' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './257/37' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './257' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/21' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/27' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/31' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/36' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/20' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/39' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/34' 2024-04-26T18:02:59.647 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/38' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/28' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/24' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/29' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/32' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/22' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/25' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/30' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/33' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/23' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/35' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/26' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed './258/37' 2024-04-26T18:02:59.648 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './258' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/21' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/27' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/31' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/36' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/20' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/39' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/34' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/38' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/28' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/24' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/29' 2024-04-26T18:02:59.649 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/32' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/22' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/25' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/30' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/33' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/23' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/35' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/26' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed './259/37' 2024-04-26T18:02:59.650 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './259' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/21' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/27' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/31' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/36' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/20' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/39' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/34' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/38' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/28' 2024-04-26T18:02:59.651 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/24' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/29' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/32' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/22' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/25' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/30' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/33' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/23' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/35' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/26' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './260/37' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './260' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/21' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/27' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/31' 2024-04-26T18:02:59.652 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/36' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/20' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/39' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/34' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/38' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/28' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/24' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/29' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/32' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/22' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/25' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/30' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/33' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/23' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/35' 2024-04-26T18:02:59.653 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/26' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './261/37' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './261' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/21' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/27' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/31' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/36' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/20' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/39' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/34' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/38' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/28' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/24' 2024-04-26T18:02:59.654 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/29' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/32' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/22' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/25' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/30' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/33' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/23' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/35' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/26' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './262/37' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './262' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/21' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/27' 2024-04-26T18:02:59.655 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/31' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/36' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/20' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/39' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/34' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/38' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/28' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/24' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/29' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/32' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/22' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/25' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/30' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/33' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/23' 2024-04-26T18:02:59.656 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/35' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/26' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './263/37' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './263' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/21' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/27' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/31' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/36' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/20' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/39' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/34' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/38' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/28' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/24' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/29' 2024-04-26T18:02:59.657 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/32' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/22' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/25' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/30' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/33' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/23' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/35' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/26' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './264/37' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './264' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/21' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/27' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/31' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/36' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/20' 2024-04-26T18:02:59.658 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/39' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/34' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/38' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/28' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/24' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/29' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/32' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/22' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/25' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/30' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/33' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/23' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/35' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/26' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed './265/37' 2024-04-26T18:02:59.659 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './265' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/21' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/27' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/31' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/36' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/20' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/39' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/34' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/38' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/28' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/24' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/29' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/32' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/22' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/25' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/30' 2024-04-26T18:02:59.660 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/33' 2024-04-26T18:02:59.661 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/23' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/35' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/26' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './266/37' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './266' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/21' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/27' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/31' 2024-04-26T18:03:00.126 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/36' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/20' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/39' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/34' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/38' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/28' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/24' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/29' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/32' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/22' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/25' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/30' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/33' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/23' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/35' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/26' 2024-04-26T18:03:00.127 INFO:tasks.workunit.client.0.smithi012.stdout:removed './267/37' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './267' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/21' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/27' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/31' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/36' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/20' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/39' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/34' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/38' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/28' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/24' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/29' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/32' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/22' 2024-04-26T18:03:00.128 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/25' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/30' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/33' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/23' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/35' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/26' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './268/37' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './268' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/21' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/27' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/31' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/36' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/20' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/39' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/34' 2024-04-26T18:03:00.129 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/38' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/28' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/24' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/29' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/32' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/22' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/25' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/30' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/33' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/23' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/35' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/26' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './269/37' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './269' 2024-04-26T18:03:00.130 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/21' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/27' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/31' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/36' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/20' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/39' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/34' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/38' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/28' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/24' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/29' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/32' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/22' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/25' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/30' 2024-04-26T18:03:00.131 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/33' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/23' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/35' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/26' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './270/37' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './270' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/21' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/27' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/31' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/36' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/20' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/39' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/34' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/38' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/28' 2024-04-26T18:03:00.132 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/24' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/29' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/32' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/22' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/25' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/30' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/33' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/23' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/35' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/26' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './271/37' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './271' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/21' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/27' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/31' 2024-04-26T18:03:00.133 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/36' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/20' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/39' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/34' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/38' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/28' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/24' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/29' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/32' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/22' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/25' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/30' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/33' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/23' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/35' 2024-04-26T18:03:00.134 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/26' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './272/37' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './272' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/21' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/27' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/31' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/36' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/20' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/39' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/34' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/38' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/28' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/24' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/29' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/32' 2024-04-26T18:03:00.135 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/22' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/25' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/30' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/33' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/23' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/35' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/26' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './273/37' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './273' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/21' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/27' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/31' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/36' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/20' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/39' 2024-04-26T18:03:00.136 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/34' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/38' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/28' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/24' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/29' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/32' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/22' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/25' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/30' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/33' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/23' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/35' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/26' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './274/37' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './274' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/21' 2024-04-26T18:03:00.137 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/27' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/31' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/36' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/20' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/39' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/34' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/38' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/28' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/24' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/29' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/32' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/22' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/25' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/30' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/33' 2024-04-26T18:03:00.138 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/23' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/35' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/26' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './275/37' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './275' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/21' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/27' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/31' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/36' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/20' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/39' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/34' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/38' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/28' 2024-04-26T18:03:00.139 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/24' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/29' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/32' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/22' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/25' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/30' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/33' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/23' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/35' 2024-04-26T18:03:00.140 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/26' 2024-04-26T18:03:01.167 INFO:tasks.workunit.client.0.smithi012.stdout:removed './276/37' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './276' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/21' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/27' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/31' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/36' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/20' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/39' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/34' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/38' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/28' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/24' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/29' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/32' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/22' 2024-04-26T18:03:01.168 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/25' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/30' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/33' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/23' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/35' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/26' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './277/37' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './277' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/21' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/27' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/31' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/36' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/20' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/39' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/34' 2024-04-26T18:03:01.169 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/38' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/28' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/24' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/29' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/32' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/22' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/25' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/30' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/33' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/23' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/35' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/26' 2024-04-26T18:03:01.170 INFO:tasks.workunit.client.0.smithi012.stdout:removed './278/37' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './278' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/21' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/27' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/31' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/36' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/20' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/39' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/34' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/38' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/28' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/24' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/29' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/32' 2024-04-26T18:03:01.171 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/22' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/25' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/30' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/33' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/23' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/35' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/26' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './279/37' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './279' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/21' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/27' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/31' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/36' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/20' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/39' 2024-04-26T18:03:01.172 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/34' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/38' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/28' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/24' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/29' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/32' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/22' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/25' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/30' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/33' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/23' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/35' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/26' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './280/37' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './280' 2024-04-26T18:03:01.173 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/21' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/27' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/31' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/36' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/20' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/39' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/34' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/38' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/28' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/24' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/29' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/32' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/22' 2024-04-26T18:03:01.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/25' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/30' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/33' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/23' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/35' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/26' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './281/37' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './281' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/21' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/27' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/31' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/36' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/20' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/39' 2024-04-26T18:03:01.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/34' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/38' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/28' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/24' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/29' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/32' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/22' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/25' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/30' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/33' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/23' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/35' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/26' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './282/37' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './282' 2024-04-26T18:03:01.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/21' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/27' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/31' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/36' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/20' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/39' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/34' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/38' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/28' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/24' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/29' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/32' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/22' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/25' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/30' 2024-04-26T18:03:01.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/33' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/23' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/35' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/26' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './283/37' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './283' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/21' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/27' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/31' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/36' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/20' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/39' 2024-04-26T18:03:01.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/34' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/38' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/28' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/24' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/29' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/32' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/22' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/25' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/30' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/33' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/23' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/35' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/26' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './284/37' 2024-04-26T18:03:01.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './284' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/21' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/27' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/31' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/36' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/20' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/39' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/34' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/38' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/28' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/24' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/29' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/32' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/22' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/25' 2024-04-26T18:03:01.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/30' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/33' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/23' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/35' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/26' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './285/37' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './285' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/21' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/27' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/31' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/36' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/20' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/39' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/34' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/38' 2024-04-26T18:03:01.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/28' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/24' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/29' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/32' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/22' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/25' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/30' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/33' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/23' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/35' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/26' 2024-04-26T18:03:01.182 INFO:tasks.workunit.client.0.smithi012.stdout:removed './286/37' 2024-04-26T18:03:01.183 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './286' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/21' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/27' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/31' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/36' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/20' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/39' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/34' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/38' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/28' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/24' 2024-04-26T18:03:03.555 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/29' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/32' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/22' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/25' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/30' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/33' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/23' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/35' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/26' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './287/37' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './287' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/21' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/27' 2024-04-26T18:03:03.556 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/31' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/36' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/20' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/39' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/34' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/38' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/28' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/24' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/29' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/32' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/22' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/25' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/30' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/33' 2024-04-26T18:03:03.557 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/23' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/35' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/26' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './288/37' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './288' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/21' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/27' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/31' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/36' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/20' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/39' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/34' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/38' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/28' 2024-04-26T18:03:03.558 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/24' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/29' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/32' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/22' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/25' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/30' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/33' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/23' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/35' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/26' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './289/37' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './289' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/21' 2024-04-26T18:03:03.559 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/27' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/31' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/36' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/20' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/39' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/34' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/38' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/28' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/24' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/29' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/32' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/22' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/25' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/30' 2024-04-26T18:03:03.560 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/33' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/23' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/35' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/26' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './290/37' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './290' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/21' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/27' 2024-04-26T18:03:03.561 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/31' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/36' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/20' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/39' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/34' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/38' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/28' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/24' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/29' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/32' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/22' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/25' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/30' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/33' 2024-04-26T18:03:03.562 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/23' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/35' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/26' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './291/37' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './291' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/21' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/27' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/31' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/36' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/20' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/39' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/34' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/38' 2024-04-26T18:03:03.563 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/28' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/24' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/29' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/32' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/22' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/25' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/30' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/33' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/23' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/35' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/26' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './292/37' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './292' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/21' 2024-04-26T18:03:03.564 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/27' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/31' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/36' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/20' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/39' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/34' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/38' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/28' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/24' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/29' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/32' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/22' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/25' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/30' 2024-04-26T18:03:03.565 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/33' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/23' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/35' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/26' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './293/37' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './293' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/21' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/27' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/31' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/36' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/20' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/39' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/34' 2024-04-26T18:03:03.566 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/38' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/28' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/24' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/29' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/32' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/22' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/25' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/30' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/33' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/23' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/35' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/26' 2024-04-26T18:03:03.567 INFO:tasks.workunit.client.0.smithi012.stdout:removed './294/37' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './294' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/21' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/27' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/31' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/36' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/20' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/39' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/34' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/38' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/28' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/24' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/29' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/32' 2024-04-26T18:03:03.568 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/22' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/25' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/30' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/33' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/23' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/35' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/26' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './295/37' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './295' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/21' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/27' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/31' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/36' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/20' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/39' 2024-04-26T18:03:03.569 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/34' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/38' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/28' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/24' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/29' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/32' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/22' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/25' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/30' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/33' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/23' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/35' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/26' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './296/37' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './296' 2024-04-26T18:03:03.570 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/21' 2024-04-26T18:03:03.571 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/27' 2024-04-26T18:03:05.063 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/31' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/36' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/20' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/39' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/34' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/38' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/28' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/24' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/29' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/32' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/22' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/25' 2024-04-26T18:03:05.064 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/30' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/33' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/23' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/35' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/26' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './297/37' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './297' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/21' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/27' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/31' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/36' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/20' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/39' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/34' 2024-04-26T18:03:05.065 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/38' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/28' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/24' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/29' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/32' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/22' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/25' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/30' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/33' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/23' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/35' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/26' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './298/37' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './298' 2024-04-26T18:03:05.066 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/21' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/27' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/31' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/36' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/20' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/39' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/34' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/38' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/28' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/24' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/29' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/32' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/22' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/25' 2024-04-26T18:03:05.067 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/30' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/33' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/23' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/35' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/26' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './299/37' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './299' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/19' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/15' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/20' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/12' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/10' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/11' 2024-04-26T18:03:05.068 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/16' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/14' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/18' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/13' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/166/17' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/166' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/19' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/15' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/20' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/12' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/10' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/11' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/16' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/14' 2024-04-26T18:03:05.069 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/18' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/13' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/147/17' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/147' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/19' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/15' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/20' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/12' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/10' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/11' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/16' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/14' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/18' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/13' 2024-04-26T18:03:05.070 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/151/17' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/151' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/19' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/15' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/20' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/12' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/10' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/11' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/16' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/14' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/18' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/13' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/170/17' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/170' 2024-04-26T18:03:05.071 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/19' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/15' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/20' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/12' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/10' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/11' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/16' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/14' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/18' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/13' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/167/17' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/167' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/19' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/15' 2024-04-26T18:03:05.072 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/20' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/12' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/10' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/11' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/16' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/14' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/18' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/13' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/140/17' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/140' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/19' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/15' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/20' 2024-04-26T18:03:05.073 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/12' 2024-04-26T18:03:05.074 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/10' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/11' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/16' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/14' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/18' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/13' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/142/17' 2024-04-26T18:03:06.100 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/142' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/19' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/15' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/20' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/12' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/10' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/11' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/16' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/14' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/18' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/13' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/150/17' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/150' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/19' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/15' 2024-04-26T18:03:06.101 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/20' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/12' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/10' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/11' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/16' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/14' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/18' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/13' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/105/17' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/105' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/19' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/15' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/20' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/12' 2024-04-26T18:03:06.102 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/10' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/11' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/16' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/14' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/18' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/13' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/149/17' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/149' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/19' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/15' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/20' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/12' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/10' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/11' 2024-04-26T18:03:06.103 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/16' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/14' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/18' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/13' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/109/17' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/109' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/19' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/15' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/20' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/12' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/10' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/11' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/16' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/14' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/18' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/13' 2024-04-26T18:03:06.104 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/158/17' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/158' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/19' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/15' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/20' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/12' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/10' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/11' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/16' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/14' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/18' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/13' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/106/17' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/106' 2024-04-26T18:03:06.105 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/19' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/15' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/20' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/12' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/10' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/11' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/16' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/14' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/18' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/13' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/189/17' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/189' 2024-04-26T18:03:06.106 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/19' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/15' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/20' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/12' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/10' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/11' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/16' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/14' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/18' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/13' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/133/17' 2024-04-26T18:03:06.107 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/133' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/19' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/15' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/20' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/12' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/10' 2024-04-26T18:03:06.108 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/11' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/16' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/14' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/18' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/13' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/173/17' 2024-04-26T18:03:06.962 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/173' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/19' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/15' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/20' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/12' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/10' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/11' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/16' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/14' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/18' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/13' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/174/17' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/174' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/19' 2024-04-26T18:03:06.963 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/15' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/20' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/12' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/10' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/11' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/16' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/14' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/18' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/13' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/155/17' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/155' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/19' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/15' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/20' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/12' 2024-04-26T18:03:06.964 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/10' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/11' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/16' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/14' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/18' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/13' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/114/17' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/114' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/19' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/15' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/20' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/12' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/10' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/11' 2024-04-26T18:03:06.965 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/16' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/14' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/18' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/13' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/159/17' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/159' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/19' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/15' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/20' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/12' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/10' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/11' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/16' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/14' 2024-04-26T18:03:06.966 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/18' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/13' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/187/17' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/187' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/19' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/15' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/20' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/12' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/10' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/11' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/16' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/14' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/18' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/13' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/185/17' 2024-04-26T18:03:06.967 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/185' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/19' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/15' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/20' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/12' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/10' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/11' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/16' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/14' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/18' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/13' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/120/17' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/120' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/19' 2024-04-26T18:03:06.968 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/15' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/20' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/12' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/10' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/11' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/16' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/14' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/18' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/13' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/110/17' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/110' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/19' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/15' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/20' 2024-04-26T18:03:06.969 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/12' 2024-04-26T18:03:06.970 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/10' 2024-04-26T18:03:06.970 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/11' 2024-04-26T18:03:06.970 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/16' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/14' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/18' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/13' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/137/17' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/137' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/19' 2024-04-26T18:03:08.378 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/15' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/20' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/12' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/10' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/11' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/16' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/14' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/18' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/13' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/198/17' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/198' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/19' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/15' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/20' 2024-04-26T18:03:08.379 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/12' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/10' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/11' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/16' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/14' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/18' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/13' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/136/17' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/136' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/19' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/15' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/20' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/12' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/10' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/11' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/16' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/14' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/18' 2024-04-26T18:03:08.380 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/13' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/125/17' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/125' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/19' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/15' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/20' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/12' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/10' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/11' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/16' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/14' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/18' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/13' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/194/17' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/194' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/19' 2024-04-26T18:03:08.381 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/15' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/20' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/12' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/10' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/11' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/16' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/14' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/18' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/13' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/119/17' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/119' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/19' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/15' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/20' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/12' 2024-04-26T18:03:08.382 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/10' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/11' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/16' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/14' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/18' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/13' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/157/17' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/157' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/19' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/15' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/20' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/12' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/10' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/11' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/16' 2024-04-26T18:03:08.383 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/14' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/18' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/13' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/172/17' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/172' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/19' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/15' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/20' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/12' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/10' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/11' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/16' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/14' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/18' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/13' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/186/17' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/186' 2024-04-26T18:03:08.384 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/19' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/15' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/20' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/12' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/10' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/11' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/16' 2024-04-26T18:03:08.385 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/14' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/18' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/13' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/190/17' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/190' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/19' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/15' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/20' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/12' 2024-04-26T18:03:09.224 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/10' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/11' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/16' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/14' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/18' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/13' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/104/17' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/104' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/19' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/15' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/20' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/12' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/10' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/11' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/16' 2024-04-26T18:03:09.225 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/14' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/18' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/13' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/164/17' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/164' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/19' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/15' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/20' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/12' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/10' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/11' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/16' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/14' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/18' 2024-04-26T18:03:09.226 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/13' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/112/17' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/112' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/19' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/15' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/20' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/12' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/10' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/11' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/16' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/14' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/18' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/13' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/100/17' 2024-04-26T18:03:09.227 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/100' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/19' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/15' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/20' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/12' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/10' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/11' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/16' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/14' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/18' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/13' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/134/17' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/134' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/19' 2024-04-26T18:03:09.228 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/15' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/20' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/12' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/10' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/11' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/16' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/14' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/18' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/13' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/115/17' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/115' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/19' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/15' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/20' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/12' 2024-04-26T18:03:09.229 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/10' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/11' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/16' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/14' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/18' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/13' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/116/17' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/116' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/19' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/15' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/20' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/12' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/10' 2024-04-26T18:03:09.230 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/11' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/16' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/14' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/18' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/13' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/195/17' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/195' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/19' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/15' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/20' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/12' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/10' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/11' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/16' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/14' 2024-04-26T18:03:09.231 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/18' 2024-04-26T18:03:10.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/13' 2024-04-26T18:03:10.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/138/17' 2024-04-26T18:03:10.174 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/138' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/19' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/15' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/20' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/12' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/10' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/11' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/16' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/14' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/18' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/13' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/135/17' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/135' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/19' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/15' 2024-04-26T18:03:10.175 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/20' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/12' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/10' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/11' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/16' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/14' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/18' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/13' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/117/17' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/117' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/19' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/15' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/20' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/12' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/10' 2024-04-26T18:03:10.176 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/11' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/16' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/14' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/18' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/13' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/143/17' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/143' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/19' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/15' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/20' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/12' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/10' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/11' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/16' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/14' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/18' 2024-04-26T18:03:10.177 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/13' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/180/17' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/180' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/19' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/15' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/20' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/12' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/10' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/11' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/16' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/14' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/18' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/13' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/126/17' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/126' 2024-04-26T18:03:10.178 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/19' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/15' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/20' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/12' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/10' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/11' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/16' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/14' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/18' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/13' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/161/17' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/161' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/19' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/15' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/20' 2024-04-26T18:03:10.179 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/12' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/10' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/11' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/16' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/14' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/18' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/13' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/176/17' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/176' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/19' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/15' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/20' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/12' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/10' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/11' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/16' 2024-04-26T18:03:10.180 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/14' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/18' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/13' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/111/17' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/111' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/19' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/15' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/20' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/12' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/10' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/11' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/16' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/14' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/18' 2024-04-26T18:03:10.181 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/13' 2024-04-26T18:03:10.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/191/17' 2024-04-26T18:03:10.396 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/191' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/19' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/15' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/20' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/12' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/10' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/11' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/16' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/14' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/18' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/13' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/184/17' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/184' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/19' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/15' 2024-04-26T18:03:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/20' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/12' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/10' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/11' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/16' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/14' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/18' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/13' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/192/17' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/192' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/19' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/15' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/20' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/12' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/10' 2024-04-26T18:03:10.398 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/11' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/16' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/14' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/18' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/13' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/103/17' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/103' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/19' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/15' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/20' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/12' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/10' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/11' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/16' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/14' 2024-04-26T18:03:10.399 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/18' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/13' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/128/17' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/128' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/19' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/15' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/20' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/12' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/10' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/11' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/16' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/14' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/18' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/13' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/144/17' 2024-04-26T18:03:10.400 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/144' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/19' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/15' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/20' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/12' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/10' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/11' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/16' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/14' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/18' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/13' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/146/17' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/146' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/19' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/15' 2024-04-26T18:03:10.401 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/20' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/12' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/10' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/11' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/16' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/14' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/18' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/13' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/141/17' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/141' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/19' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/15' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/20' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/12' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/10' 2024-04-26T18:03:10.402 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/11' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/16' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/14' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/18' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/13' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/182/17' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/182' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/19' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/15' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/20' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/12' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/10' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/11' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/16' 2024-04-26T18:03:10.403 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/14' 2024-04-26T18:03:10.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/18' 2024-04-26T18:03:10.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/13' 2024-04-26T18:03:10.404 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/107/17' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/107' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/19' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/15' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/20' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/12' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/10' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/11' 2024-04-26T18:03:11.608 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/16' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/14' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/18' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/13' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/178/17' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/178' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/19' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/15' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/20' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/12' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/10' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/11' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/16' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/14' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/18' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/13' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/156/17' 2024-04-26T18:03:11.609 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/156' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/19' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/15' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/20' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/12' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/10' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/11' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/16' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/14' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/18' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/13' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/131/17' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/131' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/19' 2024-04-26T18:03:11.610 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/15' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/20' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/12' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/10' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/11' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/16' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/14' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/18' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/13' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/123/17' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/123' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/19' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/15' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/20' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/12' 2024-04-26T18:03:11.611 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/10' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/11' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/16' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/14' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/18' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/13' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/160/17' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/160' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/19' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/15' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/20' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/12' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/10' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/11' 2024-04-26T18:03:11.612 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/16' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/14' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/18' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/13' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/165/17' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/165' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/19' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/15' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/20' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/12' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/10' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/11' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/16' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/14' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/18' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/13' 2024-04-26T18:03:11.613 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/101/17' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/101' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/19' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/15' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/20' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/12' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/10' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/11' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/16' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/14' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/18' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/13' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/148/17' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/148' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/19' 2024-04-26T18:03:11.614 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/15' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/20' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/12' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/10' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/11' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/16' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/14' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/18' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/13' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/168/17' 2024-04-26T18:03:11.615 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/168' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/19' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/15' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/20' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/12' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/10' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/11' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/16' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/14' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/18' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/13' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/179/17' 2024-04-26T18:03:11.897 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/179' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/19' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/15' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/20' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/12' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/10' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/11' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/16' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/14' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/18' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/13' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/132/17' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/132' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/19' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/15' 2024-04-26T18:03:11.898 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/20' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/12' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/10' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/11' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/16' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/14' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/18' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/13' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/199/17' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/199' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/19' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/15' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/20' 2024-04-26T18:03:11.899 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/12' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/10' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/11' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/16' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/14' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/18' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/13' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/163/17' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/163' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/19' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/15' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/20' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/12' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/10' 2024-04-26T18:03:11.900 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/11' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/16' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/14' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/18' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/13' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/153/17' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/153' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/19' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/15' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/20' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/12' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/10' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/11' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/16' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/14' 2024-04-26T18:03:11.901 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/18' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/13' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/122/17' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/122' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/19' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/15' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/20' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/12' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/10' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/11' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/16' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/14' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/18' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/13' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/162/17' 2024-04-26T18:03:11.902 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/162' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/19' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/15' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/20' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/12' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/10' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/11' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/16' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/14' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/18' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/13' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/197/17' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/197' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/19' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/15' 2024-04-26T18:03:11.903 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/20' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/12' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/10' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/11' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/16' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/14' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/18' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/13' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/113/17' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/113' 2024-04-26T18:03:11.904 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/19' 2024-04-26T18:03:12.763 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/15' 2024-04-26T18:03:12.763 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/20' 2024-04-26T18:03:12.763 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/12' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/10' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/11' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/16' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/14' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/18' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/13' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/152/17' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/152' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/19' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/15' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/20' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/12' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/10' 2024-04-26T18:03:12.764 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/11' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/16' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/14' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/18' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/13' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/121/17' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/121' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/19' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/15' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/20' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/12' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/10' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/11' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/16' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/14' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/18' 2024-04-26T18:03:12.765 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/13' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/118/17' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/118' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/19' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/15' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/20' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/12' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/10' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/11' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/16' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/14' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/18' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/13' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/196/17' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/196' 2024-04-26T18:03:12.766 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/19' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/15' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/20' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/12' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/10' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/11' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/16' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/14' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/18' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/13' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/124/17' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/124' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/19' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/15' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/20' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/12' 2024-04-26T18:03:12.767 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/10' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/11' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/16' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/14' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/18' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/13' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/188/17' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/188' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/19' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/15' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/20' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/12' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/10' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/11' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/16' 2024-04-26T18:03:12.768 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/14' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/18' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/13' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/145/17' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/145' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/19' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/15' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/20' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/12' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/10' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/11' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/16' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/14' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/18' 2024-04-26T18:03:12.769 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/13' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/130/17' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/130' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/19' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/15' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/20' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/12' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/10' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/11' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/16' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/14' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/18' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/13' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/193/17' 2024-04-26T18:03:12.770 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/193' 2024-04-26T18:03:12.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/19' 2024-04-26T18:03:12.771 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/15' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/20' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/12' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/10' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/11' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/16' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/14' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/18' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/13' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/175/17' 2024-04-26T18:03:13.668 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/175' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/19' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/15' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/20' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/12' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/10' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/11' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/16' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/14' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/18' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/13' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/181/17' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/181' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/19' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/15' 2024-04-26T18:03:13.669 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/20' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/12' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/10' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/11' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/16' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/14' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/18' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/13' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/127/17' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/127' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/19' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/15' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/20' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/12' 2024-04-26T18:03:13.670 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/10' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/11' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/16' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/14' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/18' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/13' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/108/17' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/108' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/19' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/15' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/20' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/12' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/10' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/11' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/16' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/14' 2024-04-26T18:03:13.671 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/18' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/13' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/183/17' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/183' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/19' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/15' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/20' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/12' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/10' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/11' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/16' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/14' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/18' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/13' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/177/17' 2024-04-26T18:03:13.672 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/177' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/19' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/15' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/20' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/12' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/10' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/11' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/16' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/14' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/18' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/13' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/169/17' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/169' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/19' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/15' 2024-04-26T18:03:13.673 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/20' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/12' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/10' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/11' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/16' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/14' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/18' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/13' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/154/17' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/154' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/19' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/15' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/20' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/12' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/10' 2024-04-26T18:03:13.674 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/11' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/16' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/14' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/18' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/13' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/171/17' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/171' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/19' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/15' 2024-04-26T18:03:13.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/20' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/12' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/10' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/11' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/16' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/14' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/18' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/13' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/139/17' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/139' 2024-04-26T18:03:14.675 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/19' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/15' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/20' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/12' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/10' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/11' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/16' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/14' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/18' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/13' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/102/17' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/102' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/19' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/15' 2024-04-26T18:03:14.676 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/20' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/12' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/10' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/11' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/16' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/14' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/18' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/13' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed './copyofsnap1/test1/129/17' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1/129' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1/test1' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:removed directory './copyofsnap1' 2024-04-26T18:03:14.677 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:14.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:14.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:14.715 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-04-26T18:03:14.716 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-04-26T18:03:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:+ set -e 2024-04-26T18:03:14.780 INFO:tasks.workunit.client.0.smithi012.stderr:+ touch foo 2024-04-26T18:03:14.782 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod +x foo 2024-04-26T18:03:14.783 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir .snap/s 2024-04-26T18:03:14.793 INFO:tasks.workunit.client.0.smithi012.stderr:+ find .snap/s/foo -executable 2024-04-26T18:03:14.793 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep foo 2024-04-26T18:03:14.795 INFO:tasks.workunit.client.0.smithi012.stdout:.snap/s/foo 2024-04-26T18:03:14.795 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir .snap/s 2024-04-26T18:03:14.800 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm foo 2024-04-26T18:03:14.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:14.803 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:14.804 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:03:14.804 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:14.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:14.846 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:14.878 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-04-26T18:03:14.878 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-04-26T18:03:14.953 INFO:tasks.workunit.client.0.smithi012.stderr:+ set -e 2024-04-26T18:03:14.953 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir foo 2024-04-26T18:03:14.955 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo x 2024-04-26T18:03:14.956 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:16.477 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir foo/.snap/ss 2024-04-26T18:03:16.485 INFO:tasks.workunit.client.0.smithi012.stderr:+ ln foo/x foo/xx 2024-04-26T18:03:16.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat foo/.snap/ss/x 2024-04-26T18:03:17.127 INFO:tasks.workunit.client.0.smithi012.stdout:x 2024-04-26T18:03:17.127 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir foo/.snap/ss 2024-04-26T18:03:17.134 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo a 2024-04-26T18:03:17.134 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo b 2024-04-26T18:03:17.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir foo/.snap/s 2024-04-26T18:03:17.143 INFO:tasks.workunit.client.0.smithi012.stderr:++ cat foo/.snap/s/a 2024-04-26T18:03:17.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ r=a 2024-04-26T18:03:17.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -z a ']' 2024-04-26T18:03:17.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ ln foo/b foo/b2 2024-04-26T18:03:17.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat foo/.snap/s/b 2024-04-26T18:03:17.160 INFO:tasks.workunit.client.0.smithi012.stdout:b 2024-04-26T18:03:17.161 INFO:tasks.workunit.client.0.smithi012.stdout:this used to hang: 2024-04-26T18:03:17.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'this used to hang:' 2024-04-26T18:03:17.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo more 2024-04-26T18:03:17.161 INFO:tasks.workunit.client.0.smithi012.stdout:oh, it didn't hang! good job. 2024-04-26T18:03:17.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2024-04-26T18:03:17.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat foo/b 2024-04-26T18:03:17.162 INFO:tasks.workunit.client.0.smithi012.stdout:b 2024-04-26T18:03:17.162 INFO:tasks.workunit.client.0.smithi012.stdout:more 2024-04-26T18:03:17.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir foo/.snap/s 2024-04-26T18:03:17.166 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -r foo 2024-04-26T18:03:17.179 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:17.180 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:03:17.181 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:17.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:17.256 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-04-26T18:03:17.256 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-04-26T18:03:17.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ set -e 2024-04-26T18:03:17.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:17.322 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir .snap/bar 2024-04-26T18:03:17.334 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/foo 2024-04-26T18:03:17.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/foo 2024-04-26T18:03:17.341 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:17.343 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/bar/a 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: File: .snap/bar/a 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Device: fdh/253d Inode: 1099511633797 Links: 2 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1316/ ubuntu) 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Context: unconfined_u:object_r:unlabeled_t:s0 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Access: 2024-04-26 18:03:17.322599493 +0000 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Modify: 2024-04-26 18:03:17.322599493 +0000 2024-04-26T18:03:17.346 INFO:tasks.workunit.client.0.smithi012.stdout:Change: 2024-04-26 18:03:17.322599493 +0000 2024-04-26T18:03:17.347 INFO:tasks.workunit.client.0.smithi012.stdout: Birth: 2024-04-26 18:03:17.322599493 +0000 2024-04-26T18:03:17.347 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir .snap/bar 2024-04-26T18:03:17.352 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:17.353 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:03:17.353 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:17.354 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:17.424 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-04-26T18:03:17.425 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-04-26T18:03:17.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ set -e 2024-04-26T18:03:17.488 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq 1 20 2024-04-26T18:03:17.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:17.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:17.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:17.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:17.499 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:17.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:17.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:17.585 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:17.612 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:17.613 INFO:tasks.workunit.client.0.smithi012.stdout: 48204 ? 00:00:00 ps 2024-04-26T18:03:17.613 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:17.623 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:17.626 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:17.632 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:17.632 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:17.635 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:17.635 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:17.643 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:17.648 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:17.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:17.700 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:17.721 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:17.722 INFO:tasks.workunit.client.0.smithi012.stdout: 48214 ? 00:00:00 ps 2024-04-26T18:03:17.722 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:17.731 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:17.733 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:17.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:17.739 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:17.740 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:17.741 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:17.749 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:17.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:17.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:17.810 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:17.831 INFO:tasks.workunit.client.0.smithi012.stdout: 48224 ? 00:00:00 ps 2024-04-26T18:03:17.832 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:17.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:17.841 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:17.846 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:17.846 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:17.848 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:17.848 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:17.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:17.860 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:17.861 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:17.925 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:17.946 INFO:tasks.workunit.client.0.smithi012.stdout: 48234 ? 00:00:00 ps 2024-04-26T18:03:17.947 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.169 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.182 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.190 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.204 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.205 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.259 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.281 INFO:tasks.workunit.client.0.smithi012.stdout: 48244 ? 00:00:00 ps 2024-04-26T18:03:18.282 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.291 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.301 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.301 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.312 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.325 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.326 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.380 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stdout: 48254 ? 00:00:00 ps 2024-04-26T18:03:18.381 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.391 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.393 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.402 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.402 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.410 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.419 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.420 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.451 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.471 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.472 INFO:tasks.workunit.client.0.smithi012.stdout: 48264 ? 00:00:00 ps 2024-04-26T18:03:18.472 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.481 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.483 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.492 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.493 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.501 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.506 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.570 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.590 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stdout: 48274 ? 00:00:00 ps 2024-04-26T18:03:18.591 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.601 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.603 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.609 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.609 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.612 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.612 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.619 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.624 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.625 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.684 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.705 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stdout: 48284 ? 00:00:00 ps 2024-04-26T18:03:18.706 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.715 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.717 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.722 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.724 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.724 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.730 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.735 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.735 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.778 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.798 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.798 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.798 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.799 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48294 ? 00:00:00 ps 2024-04-26T18:03:18.799 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.807 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.809 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.813 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.813 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.815 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.815 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.822 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.834 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.834 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:18.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:18.923 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stdout: 48304 ? 00:00:00 ps 2024-04-26T18:03:18.924 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:18.934 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:18.936 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:18.942 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:18.942 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:18.945 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:18.945 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:18.954 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:18.959 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:18.960 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:19.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stdout: 48314 ? 00:00:00 ps 2024-04-26T18:03:19.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:19.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:19.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:19.066 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:19.066 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:19.069 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:19.069 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:19.076 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:19.081 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:19.082 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:19.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:19.149 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:19.149 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:19.149 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:19.149 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:19.149 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:19.150 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:19.150 INFO:tasks.workunit.client.0.smithi012.stdout: 48324 ? 00:00:00 ps 2024-04-26T18:03:19.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:19.158 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:19.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:19.164 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:19.164 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:19.166 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:19.166 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:19.497 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:19.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:19.929 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:20.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:20.833 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stdout: 48335 ? 00:00:00 ps 2024-04-26T18:03:20.834 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:20.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:20.848 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:20.854 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:20.854 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:20.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:20.857 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:20.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:20.870 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:20.870 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:20.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:20.992 INFO:tasks.workunit.client.0.smithi012.stdout: 48345 ? 00:00:00 ps 2024-04-26T18:03:20.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.005 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.007 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.014 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:21.014 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:21.016 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:21.016 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:21.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:21.029 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:21.030 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:21.070 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:21.091 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:21.091 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:21.091 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:21.091 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:21.092 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:21.092 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:21.092 INFO:tasks.workunit.client.0.smithi012.stdout: 48355 ? 00:00:00 ps 2024-04-26T18:03:21.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.103 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:21.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:21.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:21.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:21.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:21.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:21.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:21.170 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stdout: 48365 ? 00:00:00 ps 2024-04-26T18:03:21.191 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.200 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.202 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:21.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:21.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:21.210 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:21.217 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:21.222 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:21.223 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:21.287 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:21.308 INFO:tasks.workunit.client.0.smithi012.stdout: 48375 ? 00:00:00 ps 2024-04-26T18:03:21.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.317 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.319 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.324 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:21.324 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:21.326 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:21.326 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:21.333 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:21.586 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:21.587 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:21.777 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stdout: 48385 ? 00:00:00 ps 2024-04-26T18:03:21.799 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.809 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.816 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 20` 2024-04-26T18:03:21.816 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a 2024-04-26T18:03:21.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/one 2024-04-26T18:03:21.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ cat 2024-04-26T18:03:21.826 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir a/.snap/two 2024-04-26T18:03:21.831 INFO:tasks.workunit.client.0.smithi012.stderr:+ chmod 777 a/foo 2024-04-26T18:03:21.832 INFO:tasks.workunit.client.0.smithi012.stderr:+ sync 2024-04-26T18:03:21.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ ps 2024-04-26T18:03:21.925 INFO:tasks.workunit.client.0.smithi012.stdout: PID TTY TIME CMD 2024-04-26T18:03:21.925 INFO:tasks.workunit.client.0.smithi012.stdout: 5376 ? 00:00:00 systemd 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stdout: 5378 ? 00:00:00 (sd-pam) 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stdout: 20492 ? 00:00:00 sshd 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stdout: 48178 ? 00:00:00 timeout 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stdout: 48196 ? 00:00:00 snaptest-double 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stdout: 48395 ? 00:00:00 ps 2024-04-26T18:03:21.926 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-26T18:03:21.935 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm a/foo 2024-04-26T18:03:21.938 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir a 2024-04-26T18:03:21.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:03:21.943 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:21.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:21.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:22.015 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-04-26T18:03:22.015 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-04-26T18:03:22.076 INFO:tasks.workunit.client.0.smithi012.stderr:+ mkdir .snap/foo 2024-04-26T18:03:22.083 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2024-04-26T18:03:22.083 INFO:tasks.workunit.client.0.smithi012.stdout:We want ENOENT, not ESTALE, here. 2024-04-26T18:03:22.084 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq 1 100 2024-04-26T18:03:22.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/1 2024-04-26T18:03:22.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.086 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-04-26T18:03:22.086 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.086 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/2 2024-04-26T18:03:22.086 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.087 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-04-26T18:03:22.087 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.088 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/3 2024-04-26T18:03:22.088 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.088 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-04-26T18:03:22.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/4 2024-04-26T18:03:22.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.090 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-04-26T18:03:22.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/5 2024-04-26T18:03:22.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.091 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-04-26T18:03:22.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/6 2024-04-26T18:03:22.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.092 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-04-26T18:03:22.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/7 2024-04-26T18:03:22.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.093 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-04-26T18:03:22.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/8 2024-04-26T18:03:22.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.095 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-04-26T18:03:22.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/9 2024-04-26T18:03:22.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.097 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-04-26T18:03:22.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/10 2024-04-26T18:03:22.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.098 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-04-26T18:03:22.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/11 2024-04-26T18:03:22.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.099 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-04-26T18:03:22.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/12 2024-04-26T18:03:22.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.100 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-04-26T18:03:22.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/13 2024-04-26T18:03:22.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.102 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-04-26T18:03:22.102 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.102 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/14 2024-04-26T18:03:22.102 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.103 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-04-26T18:03:22.103 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.103 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/15 2024-04-26T18:03:22.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.104 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-04-26T18:03:22.105 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.105 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/16 2024-04-26T18:03:22.105 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.106 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-04-26T18:03:22.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/17 2024-04-26T18:03:22.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.107 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-04-26T18:03:22.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/18 2024-04-26T18:03:22.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.108 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-04-26T18:03:22.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/19 2024-04-26T18:03:22.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.109 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-04-26T18:03:22.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/20 2024-04-26T18:03:22.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.110 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-04-26T18:03:22.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/21 2024-04-26T18:03:22.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.112 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-04-26T18:03:22.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/22 2024-04-26T18:03:22.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.113 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-04-26T18:03:22.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/23 2024-04-26T18:03:22.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.115 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-04-26T18:03:22.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/24 2024-04-26T18:03:22.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.116 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-04-26T18:03:22.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/25 2024-04-26T18:03:22.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.117 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-04-26T18:03:22.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/26 2024-04-26T18:03:22.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.119 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-04-26T18:03:22.119 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.119 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/27 2024-04-26T18:03:22.119 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.120 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-04-26T18:03:22.120 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.120 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/28 2024-04-26T18:03:22.121 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.121 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-04-26T18:03:22.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/29 2024-04-26T18:03:22.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.122 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-04-26T18:03:22.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/30 2024-04-26T18:03:22.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.123 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-04-26T18:03:22.124 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.124 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/31 2024-04-26T18:03:22.124 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.125 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-04-26T18:03:22.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/32 2024-04-26T18:03:22.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.126 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-04-26T18:03:22.126 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.126 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/33 2024-04-26T18:03:22.126 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.127 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-04-26T18:03:22.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/34 2024-04-26T18:03:22.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.128 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-04-26T18:03:22.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/35 2024-04-26T18:03:22.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.129 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-04-26T18:03:22.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/36 2024-04-26T18:03:22.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.131 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-04-26T18:03:22.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/37 2024-04-26T18:03:22.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.132 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-04-26T18:03:22.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/38 2024-04-26T18:03:22.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.133 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-04-26T18:03:22.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/39 2024-04-26T18:03:22.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.134 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-04-26T18:03:22.134 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/40 2024-04-26T18:03:22.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.135 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-04-26T18:03:22.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/41 2024-04-26T18:03:22.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.136 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-04-26T18:03:22.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/42 2024-04-26T18:03:22.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.138 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-04-26T18:03:22.138 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.138 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/43 2024-04-26T18:03:22.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.139 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-04-26T18:03:22.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/44 2024-04-26T18:03:22.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.140 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-04-26T18:03:22.141 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.141 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/45 2024-04-26T18:03:22.141 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.142 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-04-26T18:03:22.142 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.142 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/46 2024-04-26T18:03:22.142 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.143 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-04-26T18:03:22.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/47 2024-04-26T18:03:22.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.144 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-04-26T18:03:22.144 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.145 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/48 2024-04-26T18:03:22.145 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.145 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-04-26T18:03:22.146 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.146 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/49 2024-04-26T18:03:22.146 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.147 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-04-26T18:03:22.147 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.147 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/50 2024-04-26T18:03:22.147 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.148 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-04-26T18:03:22.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/51 2024-04-26T18:03:22.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.149 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-04-26T18:03:22.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/52 2024-04-26T18:03:22.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.150 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-04-26T18:03:22.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/53 2024-04-26T18:03:22.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.151 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-04-26T18:03:22.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/54 2024-04-26T18:03:22.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.152 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-04-26T18:03:22.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/55 2024-04-26T18:03:22.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.153 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-04-26T18:03:22.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/56 2024-04-26T18:03:22.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.155 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-04-26T18:03:22.155 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.155 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/57 2024-04-26T18:03:22.155 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.156 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-04-26T18:03:22.156 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.156 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/58 2024-04-26T18:03:22.156 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.157 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-04-26T18:03:22.158 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.158 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/59 2024-04-26T18:03:22.158 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.158 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-04-26T18:03:22.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/60 2024-04-26T18:03:22.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.159 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-04-26T18:03:22.160 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.160 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/61 2024-04-26T18:03:22.160 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.160 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-04-26T18:03:22.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/62 2024-04-26T18:03:22.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.162 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-04-26T18:03:22.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/63 2024-04-26T18:03:22.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.410 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-04-26T18:03:22.410 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.410 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/64 2024-04-26T18:03:22.410 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.411 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-04-26T18:03:22.411 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.411 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/65 2024-04-26T18:03:22.411 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.412 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-04-26T18:03:22.412 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.413 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/66 2024-04-26T18:03:22.413 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.413 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-04-26T18:03:22.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/67 2024-04-26T18:03:22.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.415 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-04-26T18:03:22.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/68 2024-04-26T18:03:22.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.416 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-04-26T18:03:22.416 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.416 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/69 2024-04-26T18:03:22.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.417 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-04-26T18:03:22.418 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.418 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/70 2024-04-26T18:03:22.418 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.419 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-04-26T18:03:22.419 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.420 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/71 2024-04-26T18:03:22.420 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.420 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-04-26T18:03:22.420 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.421 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/72 2024-04-26T18:03:22.421 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.421 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-04-26T18:03:22.421 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/73 2024-04-26T18:03:22.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.422 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-04-26T18:03:22.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/74 2024-04-26T18:03:22.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.424 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-04-26T18:03:22.424 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.424 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/75 2024-04-26T18:03:22.424 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.425 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-04-26T18:03:22.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/76 2024-04-26T18:03:22.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.426 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-04-26T18:03:22.426 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.427 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/77 2024-04-26T18:03:22.427 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.427 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-04-26T18:03:22.428 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.428 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/78 2024-04-26T18:03:22.428 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.429 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-04-26T18:03:22.429 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.429 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/79 2024-04-26T18:03:22.429 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.666 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-04-26T18:03:22.667 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.667 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/80 2024-04-26T18:03:22.667 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.862 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-04-26T18:03:22.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/81 2024-04-26T18:03:22.863 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.863 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-04-26T18:03:22.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/82 2024-04-26T18:03:22.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.865 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-04-26T18:03:22.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/83 2024-04-26T18:03:22.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.866 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-04-26T18:03:22.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/84 2024-04-26T18:03:22.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.867 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-04-26T18:03:22.868 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.868 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/85 2024-04-26T18:03:22.868 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.869 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-04-26T18:03:22.869 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.869 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/86 2024-04-26T18:03:22.869 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.870 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-04-26T18:03:22.871 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.871 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/87 2024-04-26T18:03:22.871 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.872 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-04-26T18:03:22.873 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.873 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/88 2024-04-26T18:03:22.873 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.873 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-04-26T18:03:22.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/89 2024-04-26T18:03:22.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.875 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-04-26T18:03:22.875 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.875 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/90 2024-04-26T18:03:22.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.876 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-04-26T18:03:22.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/91 2024-04-26T18:03:22.877 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.877 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-04-26T18:03:22.878 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.878 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/92 2024-04-26T18:03:22.878 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.879 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-04-26T18:03:22.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/93 2024-04-26T18:03:22.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.880 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-04-26T18:03:22.880 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.880 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/94 2024-04-26T18:03:22.881 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.881 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-04-26T18:03:22.882 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.882 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/95 2024-04-26T18:03:22.882 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.883 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-04-26T18:03:22.883 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.883 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/96 2024-04-26T18:03:22.884 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.884 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-04-26T18:03:22.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/97 2024-04-26T18:03:22.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.885 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-04-26T18:03:22.886 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.886 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/98 2024-04-26T18:03:22.886 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.887 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-04-26T18:03:22.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/99 2024-04-26T18:03:22.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.888 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-04-26T18:03:22.889 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in `seq 1 100` 2024-04-26T18:03:22.889 INFO:tasks.workunit.client.0.smithi012.stderr:+ stat .snap/foo/100 2024-04-26T18:03:22.889 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'No such file' 2024-04-26T18:03:22.890 INFO:tasks.workunit.client.0.smithi012.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-04-26T18:03:22.890 INFO:tasks.workunit.client.0.smithi012.stderr:+ rmdir .snap/foo 2024-04-26T18:03:22.895 INFO:tasks.workunit.client.0.smithi012.stdout:OK 2024-04-26T18:03:22.896 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo OK 2024-04-26T18:03:22.897 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T18:03:22.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T18:03:22.965 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-04-26T18:03:22.965 DEBUG:teuthology.orchestra.run.smithi012:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-04-26T18:03:23.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ set -e 2024-04-26T18:03:23.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ sudo git config --global http.sslVerify false 2024-04-26T18:03:23.039 INFO:tasks.workunit.client.0.smithi012.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-04-26T18:03:23.050 INFO:tasks.workunit.client.0.smithi012.stderr:+ retried=false 2024-04-26T18:03:23.050 INFO:tasks.workunit.client.0.smithi012.stderr:+ trap -- retry EXIT 2024-04-26T18:03:23.050 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf ceph 2024-04-26T18:03:23.051 INFO:tasks.workunit.client.0.smithi012.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-04-26T18:03:23.053 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into 'ceph'... 2024-04-26T18:03:44.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:03:44.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:02.591 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-04-26T18:04:02.591 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:04:02.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.700+0000 7f8ece67e640 1 Processor -- start 2024-04-26T18:04:02.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.700+0000 7f8ece67e640 1 -- start start 2024-04-26T18:04:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.701+0000 7f8ece67e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ec8155fe0 0x7f8ec80c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.701+0000 7f8ece67e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec80cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.701+0000 7f8ece67e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec80c9230 con 0x7f8ec80c8370 2024-04-26T18:04:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.701+0000 7f8ece67e640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec815f3f0 con 0x7f8ec8155fe0 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.701+0000 7f8ece67e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec8160190 con 0x7f8ec80c9f70 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ec8155fe0 0x7f8ec80c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ec8155fe0 0x7f8ec80c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43060/0 (socket says 172.21.15.12:43060) 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 -- 172.21.15.12:0/4157164832 learned_addr learned my addr 172.21.15.12:0/4157164832 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8eccc1b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8ec80c8370 0x7f8ec815bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54814/0 (socket says 172.21.15.12:54814) 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec77fe640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec80cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec6ffd640 1 -- 172.21.15.12:0/4157164832 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342060372 0 0) 0x7f8ec80c9230 con 0x7f8ec80c8370 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec6ffd640 1 -- 172.21.15.12:0/4157164832 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eb0003520 con 0x7f8ec80c8370 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 -- 172.21.15.12:0/4157164832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 msgr2=0x7f8ec80cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec80cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 -- 172.21.15.12:0/4157164832 >> v1:172.21.15.12:6789/0 conn(0x7f8ec80c8370 legacy=0x7f8ec815bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.702+0000 7f8ec7fff640 1 -- 172.21.15.12:0/4157164832 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec815f6b0 con 0x7f8ec8155fe0 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.703+0000 7f8ec7fff640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec80c9a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009870 tx=0x7f8eb802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfac79734a049b66 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.703+0000 7f8ec6ffd640 1 -- 172.21.15.12:0/4157164832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8037070 con 0x7f8ec8155fe0 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.703+0000 7f8ec6ffd640 1 -- 172.21.15.12:0/4157164832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb802ae50 con 0x7f8ec8155fe0 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.703+0000 7f8ec6ffd640 1 -- 172.21.15.12:0/4157164832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8032860 con 0x7f8ec8155fe0 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.703+0000 7f8ece67e640 1 -- 172.21.15.12:0/4157164832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 msgr2=0x7f8ec80c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec80c9a30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009870 tx=0x7f8eb802a300 comp rx=0 tx=0).stop 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 -- 172.21.15.12:0/4157164832 shutdown_connections 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec80cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 --2- 172.21.15.12:0/4157164832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec80c9a30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 -- 172.21.15.12:0/4157164832 >> 172.21.15.12:0/4157164832 conn(0x7f8ec80703d0 msgr2=0x7f8ec80707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 -- 172.21.15.12:0/4157164832 shutdown_connections 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.704+0000 7f8ece67e640 1 -- 172.21.15.12:0/4157164832 wait complete. 2024-04-26T18:04:02.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.705+0000 7f8ece67e640 1 Processor -- start 2024-04-26T18:04:02.706 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.705+0000 7f8ece67e640 1 -- start start 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ec80c8370 0x7f8ec81f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec8159b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec81563c0 con 0x7f8ec8155fe0 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec815fc70 con 0x7f8ec80c8370 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ece67e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec80c8ef0 con 0x7f8ec80c9f70 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43066/0 (socket says 172.21.15.12:43066) 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 -- 172.21.15.12:0/3699570304 learned_addr learned my addr 172.21.15.12:0/3699570304 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ec7fff640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ec80c8370 0x7f8ec81f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8ec77fe640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec8159b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 -- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 msgr2=0x7f8ec8159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec8159b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.707 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 -- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ec80c8370 msgr2=0x7f8ec81f1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ec80c8370 0x7f8ec81f1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 -- 172.21.15.12:0/3699570304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec81f2460 con 0x7f8ec8155fe0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.706+0000 7f8eccc1b640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c7b0 tx=0x7f8ec000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.707+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ec8155fe0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.707+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec000a640 con 0x7f8ec8155fe0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.707+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000aa10 con 0x7f8ec8155fe0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.707+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec8158ea0 con 0x7f8ec8155fe0 2024-04-26T18:04:02.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.707+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec8159460 con 0x7f8ec8155fe0 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.708+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec8076d20 con 0x7f8ec8155fe0 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.709+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ec001a070 con 0x7f8ec8155fe0 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.709+0000 7f8ec4ff9640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 0x7f8eb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.709+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f8ec008b520 con 0x7f8ec8155fe0 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.709+0000 7f8ec7fff640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 0x7f8eb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:02.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.710+0000 7f8ec7fff640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 0x7f8eb406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8034000 tx=0x7f8eb802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:02.713 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.714+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8ec0058f50 con 0x7f8ec8155fe0 2024-04-26T18:04:02.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.952+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ec81f1a30 con 0x7f8ec8155fe0 2024-04-26T18:04:02.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.952+0000 7f8ec4ff9640 1 -- 172.21.15.12:0/3699570304 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f8ec005d250 con 0x7f8ec8155fe0 2024-04-26T18:04:02.952 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:04:02.952 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:04:02.952 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 msgr2=0x7f8eb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 0x7f8eb406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8034000 tx=0x7f8eb802e000 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 msgr2=0x7f8ec81568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c7b0 tx=0x7f8ec000cc70 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 shutdown_connections 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ec8155fe0 0x7f8ec81568a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8eb406c8f0 0x7f8eb406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8ec80c9f70 0x7f8ec8159b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 --2- 172.21.15.12:0/3699570304 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8ec80c8370 0x7f8ec81f1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 >> 172.21.15.12:0/3699570304 conn(0x7f8ec80703d0 msgr2=0x7f8ec8154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 shutdown_connections 2024-04-26T18:04:02.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:02.954+0000 7f8ece67e640 1 -- 172.21.15.12:0/3699570304 wait complete. 2024-04-26T18:04:02.965 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0' 2024-04-26T18:04:02.966 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0 2024-04-26T18:04:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.078+0000 7fabbfa93640 1 Processor -- start 2024-04-26T18:04:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.078+0000 7fabbfa93640 1 -- start start 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.079+0000 7fabbfa93640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabb80c64b0 0x7fabb80c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.079+0000 7fabbfa93640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb8156200 con 0x7fabb80c6900 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.079+0000 7fabbfa93640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb80cd550 con 0x7fabb8155e20 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.079+0000 7fabbfa93640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fabb815c330 con 0x7fabb80c64b0 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.079+0000 7fabbd02e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabb80c64b0 0x7fabb80c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbd02e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fabb80c64b0 0x7fabb80c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43078/0 (socket says 172.21.15.12:43078) 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbe030640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fabb80c6900 0x7fabb80cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54830/0 (socket says 172.21.15.12:54830) 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbd02e640 1 -- 172.21.15.12:0/843554476 learned_addr learned my addr 172.21.15.12:0/843554476 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbd02e640 1 -- 172.21.15.12:0/843554476 >> v1:172.21.15.100:6789/0 conn(0x7fabb8155e20 legacy=0x7fabb815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbd02e640 1 -- 172.21.15.12:0/843554476 >> v1:172.21.15.12:6789/0 conn(0x7fabb80c6900 legacy=0x7fabb80cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.080+0000 7fabbd02e640 1 -- 172.21.15.12:0/843554476 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb815c610 con 0x7fabb80c64b0 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbd02e640 1 --2- 172.21.15.12:0/843554476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb80c64b0 0x7fabb80c77f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faba8009870 tx=0x7faba802a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b1b1539b1e09f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbc82d640 1 -- 172.21.15.12:0/843554476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8037070 con 0x7fabb80c64b0 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbc82d640 1 -- 172.21.15.12:0/843554476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba8032640 con 0x7fabb80c64b0 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbc82d640 1 -- 172.21.15.12:0/843554476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8032a10 con 0x7fabb80c64b0 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 -- 172.21.15.12:0/843554476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb80c64b0 msgr2=0x7fabb80c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 --2- 172.21.15.12:0/843554476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb80c64b0 0x7fabb80c77f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faba8009870 tx=0x7faba802a3c0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 -- 172.21.15.12:0/843554476 shutdown_connections 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 --2- 172.21.15.12:0/843554476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb80c64b0 0x7fabb80c77f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 -- 172.21.15.12:0/843554476 >> 172.21.15.12:0/843554476 conn(0x7fabb8072930 msgr2=0x7fabb8072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.081 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.081+0000 7fabbfa93640 1 -- 172.21.15.12:0/843554476 shutdown_connections 2024-04-26T18:04:03.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.082+0000 7fabbfa93640 1 -- 172.21.15.12:0/843554476 wait complete. 2024-04-26T18:04:03.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.083+0000 7fabbfa93640 1 Processor -- start 2024-04-26T18:04:03.082 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.083+0000 7fabbfa93640 1 -- start start 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 0x7fabb814c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabb80c6900 0x7fabb81e4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80c72d0 con 0x7fabb8155e20 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80c6ff0 con 0x7fabb80c64b0 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80cc8d0 con 0x7fabb80c6900 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43094/0 (socket says 172.21.15.12:43094) 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 -- 172.21.15.12:0/2348081158 learned_addr learned my addr 172.21.15.12:0/2348081158 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 0x7fabb814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbd02e640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabb80c6900 0x7fabb81e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 -- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabb80c6900 msgr2=0x7fabb81e4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabb80c6900 0x7fabb81e4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 -- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 msgr2=0x7fabb814c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 0x7fabb814c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 -- 172.21.15.12:0/2348081158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb814c580 con 0x7fabb8155e20 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 0x7fabb814c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbe030640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c7d0 tx=0x7fabb000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabae7fc640 1 -- 172.21.15.12:0/2348081158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0017070 con 0x7fabb8155e20 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabae7fc640 1 -- 172.21.15.12:0/2348081158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb000a640 con 0x7fabb8155e20 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb815a280 con 0x7fabb8155e20 2024-04-26T18:04:03.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.084+0000 7fabae7fc640 1 -- 172.21.15.12:0/2348081158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb000aa30 con 0x7fabb8155e20 2024-04-26T18:04:03.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.085+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb81f57d0 con 0x7fabb8155e20 2024-04-26T18:04:03.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.086+0000 7fabae7fc640 1 -- 172.21.15.12:0/2348081158 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabb001a070 con 0x7fabb8155e20 2024-04-26T18:04:03.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.087+0000 7fabae7fc640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 0x7fab9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.087+0000 7fabae7fc640 1 -- 172.21.15.12:0/2348081158 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fabb008b510 con 0x7fabb8155e20 2024-04-26T18:04:03.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.087+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 0x7fab9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.088+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 0x7fab9c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabb4001680 tx=0x7fabb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.088+0000 7fabc27b1740 1 Processor -- start 2024-04-26T18:04:03.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.088+0000 7fabc27b1740 1 -- start start 2024-04-26T18:04:03.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460430d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x56460430df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x564604270d80 con 0x56460430d5e0 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56460420cc20 con 0x56460434cae0 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x56460426cd40 con 0x56460430eb40 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43108/0 (socket says 172.21.15.12:43108) 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 -- 172.21.15.12:0/3084071233 learned_addr learned my addr 172.21.15.12:0/3084071233 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd02e640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460430d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbe030640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x56460430df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 -- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 msgr2=0x56460430df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x56460430df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 -- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 msgr2=0x56460430d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460430d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 -- 172.21.15.12:0/3084071233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56460404ed80 con 0x56460430d5e0 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbe030640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x56460430df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fabb400d900 tx=0x7fabb4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7888cc1ed82bf87 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fab9b7fe640 1 -- 172.21.15.12:0/3084071233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4024070 con 0x56460430d5e0 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fab9b7fe640 1 -- 172.21.15.12:0/3084071233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.089+0000 7fab9b7fe640 1 -- 172.21.15.12:0/3084071233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb401f600 con 0x56460430d5e0 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 -- 172.21.15.12:0/3084071233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 msgr2=0x56460434c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fabb400d900 tx=0x7fabb4010000 comp rx=0 tx=0).stop 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 -- 172.21.15.12:0/3084071233 shutdown_connections 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x56460430df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460430d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3084071233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x56460434c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 -- 172.21.15.12:0/3084071233 >> 172.21.15.12:0/3084071233 conn(0x5646042d4740 msgr2=0x564604351580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 -- 172.21.15.12:0/3084071233 shutdown_connections 2024-04-26T18:04:03.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.090+0000 7fabc27b1740 1 -- 172.21.15.12:0/3084071233 wait complete. 2024-04-26T18:04:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.091+0000 7fabc27b1740 1 -- start start 2024-04-26T18:04:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.091+0000 7fabc27b1740 1 Processor -- start 2024-04-26T18:04:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604349c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x564604345020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x56460430bc20 con 0x56460430d5e0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x56460420a840 con 0x56460434cae0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x56460430f170 con 0x56460430eb40 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabc27b1740 10 client.0 _ll_register_callbacks cb 0x56460420e5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43112/0 (socket says 172.21.15.12:43112) 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 -- 172.21.15.12:0/2469104678 learned_addr learned my addr 172.21.15.12:0/2469104678 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd02e640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604349c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbe030640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x564604345020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 -- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 msgr2=0x564604349c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604349c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 -- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 msgr2=0x564604345020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x564604345020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 -- 172.21.15.12:0/2469104678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646040af510 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fabbd82f640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fabb40147f0 tx=0x7fabb4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1424c9a925d41c2a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.092+0000 7fab98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb402c070 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fabb4020850 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fabb4033050 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 10 client.5019 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564603f42670 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fabb4036020 con 0x56460430d5e0 2024-04-26T18:04:03.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 10 client.5019 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 10 client.5019 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 20 client.5019 populate_metadata read hostname 'smithi012' 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564604345560 0x564604345980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 4 client.5019 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56460427e990 con 0x564604345560 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.093+0000 7fabbd02e640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564604345560 0x564604345980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.094+0000 7fab98ff9640 10 client.5019 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.094+0000 7fabbd02e640 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564604345560 0x564604345980 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddbcc1102f5eb435 server_cookie=6d21432d10ff2a31 in_seq=0 out_seq=0 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.094+0000 7fab98ff9640 1 -- 172.21.15.12:0/2469104678 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56460427e990 con 0x564604345560 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.094+0000 7fab98ff9640 10 client.5019 handle_command_reply: tid=0 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 client.5019 shutdown 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 msgr2=0x5646043447e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fabb40147f0 tx=0x7fabb4014000 comp rx=0 tx=0).stop 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 shutdown_connections 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x564604345560 0x564604345980 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x564604345020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604349c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 --2- 172.21.15.12:0/2469104678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x5646043447e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 >> 172.21.15.12:0/2469104678 conn(0x5646042d4740 msgr2=0x564604336d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fab98ff9640 0 client.5019 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 shutdown_connections 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 1 -- 172.21.15.12:0/2469104678 wait complete. 2024-04-26T18:04:03.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.095+0000 7fabc27b1740 20 client.5019 trim_cache size 0 max 16384 2024-04-26T18:04:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.113+0000 7fabc27b1740 1 Processor -- start 2024-04-26T18:04:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.113+0000 7fabc27b1740 1 -- start start 2024-04-26T18:04:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460430eb40 0x5646043bf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 0x5646043bfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabb8200900 con 0x56460430d5e0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabb81ff7e0 con 0x56460430eb40 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fabb81f29c0 con 0x56460434cae0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43118/0 (socket says 172.21.15.12:43118) 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 -- 172.21.15.12:0/948748028 learned_addr learned my addr 172.21.15.12:0/948748028 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbe030640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 0x5646043bfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 -- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 msgr2=0x5646043bfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 0x5646043bfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd02e640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460430eb40 0x5646043bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 -- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460430eb40 msgr2=0x5646043bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460430eb40 0x5646043bf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 -- 172.21.15.12:0/948748028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646043485c0 con 0x56460430d5e0 2024-04-26T18:04:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbe030640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 0x5646043bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fabbd82f640 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabb4014870 tx=0x7fabb401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae34e8b36e78b10 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fab9affd640 1 -- 172.21.15.12:0/948748028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb403c070 con 0x56460430d5e0 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fab9affd640 1 -- 172.21.15.12:0/948748028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.114+0000 7fab9affd640 1 -- 172.21.15.12:0/948748028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb402c040 con 0x56460430d5e0 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 -- 172.21.15.12:0/948748028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 msgr2=0x564604367050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fabb4014870 tx=0x7fabb401d000 comp rx=0 tx=0).stop 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 -- 172.21.15.12:0/948748028 shutdown_connections 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460434cae0 0x5646043bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460430eb40 0x5646043bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 --2- 172.21.15.12:0/948748028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604367050 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 -- 172.21.15.12:0/948748028 >> 172.21.15.12:0/948748028 conn(0x5646042d4740 msgr2=0x56460434a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 -- 172.21.15.12:0/948748028 shutdown_connections 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.115+0000 7fabc27b1740 1 -- 172.21.15.12:0/948748028 wait complete. 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.116+0000 7fabc27b1740 1 -- start start 2024-04-26T18:04:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.116+0000 7fabc27b1740 1 Processor -- start 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604308530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460436b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fabb81fe3c0 con 0x56460430d5e0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fabb81ff110 con 0x56460434cae0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fabb81fea70 con 0x56460430eb40 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabc27b1740 10 client.0 _ll_register_callbacks cb 0x7fabb4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43122/0 (socket says 172.21.15.12:43122) 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 -- 172.21.15.12:0/3962559323 learned_addr learned my addr 172.21.15.12:0/3962559323 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbe030640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460436b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd02e640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604308530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 -- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 msgr2=0x564604308530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604308530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 -- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 msgr2=0x56460436b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460436b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.117+0000 7fabbd82f640 1 -- 172.21.15.12:0/3962559323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56460430ada0 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabbd82f640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabb40011f0 tx=0x7fabb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb32500f5b85e030 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb403c030 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fabb4014bb0 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fabb402c070 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 10 client.5025 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x56460430b080 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4014db0 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fabb4036050 con 0x56460430d5e0 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 10 client.5025 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:03.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 10 client.5025 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 20 client.5025 populate_metadata read hostname 'smithi012' 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5646043c1590 0x5646043c1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 4 client.5025 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}] 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.118+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}) -- 0x564604278800 con 0x5646043c1590 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.119+0000 7fabbd02e640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5646043c1590 0x5646043c1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.119+0000 7fab98ff9640 10 client.5025 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.119+0000 7fabbd02e640 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5646043c1590 0x5646043c1970 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84a45d4ff3453cba server_cookie=e626a179cbcf97d5 in_seq=0 out_seq=0 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fab98ff9640 1 -- 172.21.15.12:0/3962559323 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x564604278800 con 0x5646043c1590 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fab98ff9640 10 client.5025 handle_command_reply: tid=0 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 client.5025 shutdown 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 msgr2=0x564604343330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fabb40011f0 tx=0x7fabb4000bc0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 shutdown_connections 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5646043c1590 0x5646043c1970 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x56460434cae0 0x56460436b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fab98ff9640 0 client.5025 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x56460430eb40 0x564604308530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 --2- 172.21.15.12:0/3962559323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56460430d5e0 0x564604343330 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 >> 172.21.15.12:0/3962559323 conn(0x5646042d4740 msgr2=0x564604347030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 shutdown_connections 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 1 -- 172.21.15.12:0/3962559323 wait complete. 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.147+0000 7fabc27b1740 20 client.5025 trim_cache size 0 max 16384 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 18, 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "e7b48494": { 2024-04-26T18:04:03.148 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 18, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 91.7, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:03.149 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:03.150 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:03.150 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:04:03.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 msgr2=0x7fab9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 0x7fab9c06edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fabb4001680 tx=0x7fabb4009040 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 msgr2=0x7fabb8156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fabb000c7d0 tx=0x7fabb000cc90 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 shutdown_connections 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fabb8155e20 0x7fabb8156400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fab9c06c8f0 0x7fab9c06edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabb80c6900 0x7fabb81e4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 --2- 172.21.15.12:0/2348081158 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb80c64b0 0x7fabb814c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 >> 172.21.15.12:0/2348081158 conn(0x7fabb8072930 msgr2=0x7fabb80cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 shutdown_connections 2024-04-26T18:04:03.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:03.148+0000 7fabbfa93640 1 -- 172.21.15.12:0/2348081158 wait complete. 2024-04-26T18:04:03.158 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e7b48494', quiesce took 0.6 seconds. Will release after: 31.7 2024-04-26T18:04:14.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:14.964 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:34.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:04:34.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 Processor -- start 2024-04-26T18:04:34.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 -- start start 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f913015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913015fa00 con 0x7f91300ce070 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f913015fce0 con 0x7f91300ce450 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.973+0000 7f9136052640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f91300cc090 con 0x7f91300b4370 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912f7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f91300ce070 0x7f913015f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:34280/0 (socket says 172.21.15.12:34280) 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912f7fe640 1 -- 172.21.15.12:0/283767936 learned_addr learned my addr 172.21.15.12:0/283767936 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912effd640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f913015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329765563 0 0) 0x7f913015fa00 con 0x7f91300ce070 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9118003520 con 0x7f91300ce070 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4085975137 0 0) 0x7f913015fce0 con 0x7f91300ce450 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f913015fa00 con 0x7f91300ce450 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473380854 0 0) 0x7f9118003520 con 0x7f91300ce070 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 msgr2=0x7f913015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f913015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 >> v1:172.21.15.100:6789/0 conn(0x7f91300ce450 legacy=0x7f91300ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913015ffc0 con 0x7f91300ce070 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f9120001670 con 0x7f91300ce070 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 >> v1:172.21.15.12:6789/0 conn(0x7f91300ce070 legacy=0x7f913015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f9118003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f9118004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9118004d40 0x7f91180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91300cc090 con 0x7f91180040d0 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f911800bb50 con 0x7f9118004d40 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.974+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f911800bd20 con 0x7f91300b4370 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f9118004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912f7fe640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f9118003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912ffff640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9118004d40 0x7f91180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 -- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 msgr2=0x7f9118003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f91300b4370 0x7f9118003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 -- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9118004d40 msgr2=0x7f91180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9118004d40 0x7f91180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.975+0000 7f912effd640 1 -- 172.21.15.12:0/283767936 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9118003520 con 0x7f91180040d0 2024-04-26T18:04:34.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f912effd640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f9118004800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9124009ac0 tx=0x7f9118005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a476b365c81f81ba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124036070 con 0x7f91180040d0 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9124031400 con 0x7f91180040d0 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f912e7fc640 1 -- 172.21.15.12:0/283767936 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124009690 con 0x7f91180040d0 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 -- 172.21.15.12:0/283767936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 msgr2=0x7f9118004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 --2- 172.21.15.12:0/283767936 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f9118004800 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9124009ac0 tx=0x7f9118005830 comp rx=0 tx=0).stop 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f912ffff640 1 -- 172.21.15.12:0/283767936 reap_dead start 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 -- 172.21.15.12:0/283767936 shutdown_connections 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 -- 172.21.15.12:0/283767936 >> 172.21.15.12:0/283767936 conn(0x7f91300743c0 msgr2=0x7f9130068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 -- 172.21.15.12:0/283767936 shutdown_connections 2024-04-26T18:04:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.976+0000 7f9136052640 1 -- 172.21.15.12:0/283767936 wait complete. 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 Processor -- start 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 -- start start 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91301f1bb0 0x7f91300c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f913015edd0 0x7f91301f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f91300cd1f0 con 0x7f91180040d0 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f91300cc5c0 con 0x7f91301f1bb0 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.978+0000 7f9136052640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f91300cd370 con 0x7f913015edd0 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54184/0 (socket says 172.21.15.12:54184) 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 -- 172.21.15.12:0/1005953568 learned_addr learned my addr 172.21.15.12:0/1005953568 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912effd640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91301f1bb0 0x7f91300c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912ffff640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f913015edd0 0x7f91301f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 -- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f913015edd0 msgr2=0x7f91301f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f913015edd0 0x7f91301f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 -- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91301f1bb0 msgr2=0x7f91300c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91301f1bb0 0x7f91300c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 -- 172.21.15.12:0/1005953568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913015b4f0 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f912f7fe640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9120007340 tx=0x7f9120007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912000f860 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9120018070 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912000fc20 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91300ca070 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.979+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91300ca630 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.980+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9130076d20 con 0x7f91180040d0 2024-04-26T18:04:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.981+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f912001d460 con 0x7f91180040d0 2024-04-26T18:04:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.981+0000 7f9117fff640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 0x7f911c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.981+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f912008bef0 con 0x7f91180040d0 2024-04-26T18:04:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.982+0000 7f912effd640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 0x7f911c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.982+0000 7f912effd640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 0x7f911c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9124033000 tx=0x7f9124008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:34.986+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f91200597f0 con 0x7f91180040d0 2024-04-26T18:04:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.212+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9130159820 con 0x7f91180040d0 2024-04-26T18:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.213+0000 7f9117fff640 1 -- 172.21.15.12:0/1005953568 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f912005daf0 con 0x7f91180040d0 2024-04-26T18:04:35.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:04:35.213 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:04:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 msgr2=0x7f911c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 0x7f911c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9124033000 tx=0x7f9124008030 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 msgr2=0x7f91300cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9120007340 tx=0x7f9120007800 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 shutdown_connections 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f911c06c8f0 0x7f911c06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f913015edd0 0x7f91301f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f91301f1bb0 0x7f91300c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 --2- 172.21.15.12:0/1005953568 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f91180040d0 0x7f91300cb110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 >> 172.21.15.12:0/1005953568 conn(0x7f91300743c0 msgr2=0x7f91300c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 shutdown_connections 2024-04-26T18:04:35.216 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.215+0000 7f9136052640 1 -- 172.21.15.12:0/1005953568 wait complete. 2024-04-26T18:04:35.230 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id e7b48494 --release --await' 2024-04-26T18:04:35.230 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id e7b48494 --release --await 2024-04-26T18:04:35.338 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.338+0000 7f8c923e2640 1 Processor -- start 2024-04-26T18:04:35.339 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.338+0000 7f8c923e2640 1 -- start start 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c923e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c0c8680 0x7f8c8c0c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c923e2640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c923e2640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c8c1563f0 con 0x7f8c8c156010 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c923e2640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8c8c15fbd0 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c923e2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c15c3c0 con 0x7f8c8c0c8680 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54190/0 (socket says 172.21.15.12:54190) 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 -- 172.21.15.12:0/1528062395 learned_addr learned my addr 172.21.15.12:0/1528062395 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c0c8680 0x7f8c8c0c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 -- 172.21.15.12:0/1528062395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c0c8680 msgr2=0x7f8c8c0c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c0c8680 0x7f8c8c0c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.339+0000 7f8c9097f640 1 -- 172.21.15.12:0/1528062395 >> v1:172.21.15.100:6789/0 conn(0x7f8c8c156010 legacy=0x7f8c8c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.340+0000 7f8c9097f640 1 -- 172.21.15.12:0/1528062395 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c0c80d0 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.340+0000 7f8c9097f640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009e50 tx=0x7f8c8402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b06c2f205db9b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.340+0000 7f8c8affd640 1 -- 172.21.15.12:0/1528062395 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84036070 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.340+0000 7f8c8affd640 1 -- 172.21.15.12:0/1528062395 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84031600 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.340+0000 7f8c8affd640 1 -- 172.21.15.12:0/1528062395 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840319d0 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 -- 172.21.15.12:0/1528062395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 msgr2=0x7f8c8c0c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8c84009e50 tx=0x7f8c8402a710 comp rx=0 tx=0).stop 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 -- 172.21.15.12:0/1528062395 shutdown_connections 2024-04-26T18:04:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0c9240 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 --2- 172.21.15.12:0/1528062395 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c0c8680 0x7f8c8c0c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 -- 172.21.15.12:0/1528062395 >> 172.21.15.12:0/1528062395 conn(0x7f8c8c06eaf0 msgr2=0x7f8c8c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 -- 172.21.15.12:0/1528062395 shutdown_connections 2024-04-26T18:04:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.341+0000 7f8c923e2640 1 -- 172.21.15.12:0/1528062395 wait complete. 2024-04-26T18:04:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.342+0000 7f8c923e2640 1 Processor -- start 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.342+0000 7f8c923e2640 1 -- start start 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c8c0c8680 0x7f8c8c1f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c156010 0x7f8c8c1f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c15f580 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c15f2a0 con 0x7f8c8c0c8680 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c923e2640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c15f860 con 0x7f8c8c156010 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54204/0 (socket says 172.21.15.12:54204) 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/384981953 learned_addr learned my addr 172.21.15.12:0/384981953 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c8c0c8680 0x7f8c8c1f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c9097f640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c156010 0x7f8c8c1f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c156010 msgr2=0x7f8c8c1f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c156010 0x7f8c8c1f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c8c0c8680 msgr2=0x7f8c8c1f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c8c0c8680 0x7f8c8c1f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.343+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/384981953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c0ce190 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400d860 tx=0x7f8c7400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c88ff9640 1 -- 172.21.15.12:0/384981953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400de50 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c88ff9640 1 -- 172.21.15.12:0/384981953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c74019070 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c0cdeb0 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c88ff9640 1 -- 172.21.15.12:0/384981953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400ba90 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.344+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1f55f0 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.345+0000 7f8c88ff9640 1 -- 172.21.15.12:0/384981953 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c7400bc30 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.346+0000 7f8c88ff9640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.346+0000 7f8c88ff9640 1 -- 172.21.15.12:0/384981953 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f8c7408c220 con 0x7f8c8c0c8db0 2024-04-26T18:04:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.346+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.347+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0016e0 tx=0x7f8c7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.347+0000 7f8c951ce740 1 Processor -- start 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.347+0000 7f8c951ce740 1 -- start start 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb484b0 0x5563fcb87470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5563fcaad040 con 0x5563fcb879b0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563fca48b60 con 0x5563fcb484b0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5563fcaa9000 con 0x5563fcb49a10 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8bfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb484b0 0x5563fcb87470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54216/0 (socket says 172.21.15.12:54216) 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1322563273 learned_addr learned my addr 172.21.15.12:0/1322563273 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c9097f640 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 msgr2=0x5563fcb48dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb48dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb484b0 msgr2=0x5563fcb87470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb484b0 0x5563fcb87470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1322563273 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563fca3d9c0 con 0x5563fcb879b0 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c740621c0 tx=0x7f8c74059650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13f21e90a9ccb5a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c81ffb640 1 -- 172.21.15.12:0/1322563273 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74072020 con 0x5563fcb879b0 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c81ffb640 1 -- 172.21.15.12:0/1322563273 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740626f0 con 0x5563fcb879b0 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.348+0000 7f8c81ffb640 1 -- 172.21.15.12:0/1322563273 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74056230 con 0x5563fcb879b0 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 -- 172.21.15.12:0/1322563273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 msgr2=0x5563fcb48890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.351 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8c740621c0 tx=0x7f8c74059650 comp rx=0 tx=0).stop 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 -- 172.21.15.12:0/1322563273 shutdown_connections 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb48dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb48890 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1322563273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb484b0 0x5563fcb87470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 -- 172.21.15.12:0/1322563273 >> 172.21.15.12:0/1322563273 conn(0x5563fcb0f930 msgr2=0x5563fcb8c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 -- 172.21.15.12:0/1322563273 shutdown_connections 2024-04-26T18:04:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.349+0000 7f8c951ce740 1 -- 172.21.15.12:0/1322563273 wait complete. 2024-04-26T18:04:35.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.350+0000 7f8c951ce740 1 -- start start 2024-04-26T18:04:35.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.350+0000 7f8c951ce740 1 Processor -- start 2024-04-26T18:04:35.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.350+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb9c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcb6a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5563fcb46af0 con 0x5563fcb484b0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x5563fca464f0 con 0x5563fcb879b0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5563fcb4a040 con 0x5563fcb49a10 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 10 client.0 _ll_register_callbacks cb 0x5563fcaa3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54232/0 (socket says 172.21.15.12:54232) 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 -- 172.21.15.12:0/3617227605 learned_addr learned my addr 172.21.15.12:0/3617227605 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c9097f640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcb6a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb9c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 -- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 msgr2=0x5563fcb9c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb9c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 -- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 msgr2=0x5563fcb6a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcb6a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 -- 172.21.15.12:0/3617227605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563fc7be920 con 0x5563fcb484b0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006a30 tx=0x7f8c7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b441944229d5672a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7c021410 con 0x5563fcb484b0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f8c7c0215b0 con 0x5563fcb484b0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c740626f0 con 0x5563fcb484b0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.351+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8c7c02e050 con 0x5563fcb484b0 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 10 client.5043 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5563fc88ad30 con 0x5563fcb484b0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740626f0 con 0x5563fcb484b0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8c7c031020 con 0x5563fcb484b0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 10 client.5043 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 10 client.5043 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 20 client.5043 populate_metadata read hostname 'smithi012' 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb43450 0x5563fcb43870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 4 client.5043 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563fca80a00 con 0x5563fcb43450 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb43450 0x5563fcb43870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb43450 0x5563fcb43870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=442991b87996d559 server_cookie=dcfcb60232335764 in_seq=0 out_seq=0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.352+0000 7f8c6affd640 10 client.5043 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c6affd640 1 -- 172.21.15.12:0/3617227605 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5563fca80a00 con 0x5563fcb43450 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c6affd640 10 client.5043 handle_command_reply: tid=0 2024-04-26T18:04:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 client.5043 shutdown 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 msgr2=0x5563fcb693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006a30 tx=0x7f8c7c000ed0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 shutdown_connections 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb43450 0x5563fcb43870 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcb6a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb49a10 0x5563fcb9c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c6affd640 0 client.5043 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 --2- 172.21.15.12:0/3617227605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb484b0 0x5563fcb693c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 >> 172.21.15.12:0/3617227605 conn(0x5563fcb0f930 msgr2=0x5563fcb426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 shutdown_connections 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.353+0000 7f8c951ce740 1 -- 172.21.15.12:0/3617227605 wait complete. 2024-04-26T18:04:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.354+0000 7f8c951ce740 20 client.5043 trim_cache size 0 max 16384 2024-04-26T18:04:35.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.371+0000 7f8c951ce740 1 Processor -- start 2024-04-26T18:04:35.371 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.371+0000 7f8c951ce740 1 -- start start 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb68850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcbacdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c200a80 con 0x5563fcb49a10 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ff960 con 0x5563fcb879b0 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c1fe0c0 con 0x5563fcb484b0 2024-04-26T18:04:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54240/0 (socket says 172.21.15.12:54240) 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1465896981 learned_addr learned my addr 172.21.15.12:0/1465896981 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 msgr2=0x5563fcb68850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb68850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 msgr2=0x5563fcbacdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c9097f640 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcbacdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcbacdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 -- 172.21.15.12:0/1465896981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563fcb7fc90 con 0x5563fcb49a10 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c9097f640 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcbacdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c7408c1f0 tx=0x7f8c7406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5de69028209fdad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c817fa640 1 -- 172.21.15.12:0/1465896981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74072040 con 0x5563fcb49a10 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c817fa640 1 -- 172.21.15.12:0/1465896981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740626f0 con 0x5563fcb49a10 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.372+0000 7f8c817fa640 1 -- 172.21.15.12:0/1465896981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74056230 con 0x5563fcb49a10 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- 172.21.15.12:0/1465896981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 msgr2=0x5563fcbac8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c7408c1f0 tx=0x7f8c7406f000 comp rx=0 tx=0).stop 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- 172.21.15.12:0/1465896981 shutdown_connections 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb879b0 0x5563fcbacdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb49a10 0x5563fcbac8b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 --2- 172.21.15.12:0/1465896981 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb68850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- 172.21.15.12:0/1465896981 >> 172.21.15.12:0/1465896981 conn(0x5563fcb0f930 msgr2=0x5563fcb442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- 172.21.15.12:0/1465896981 shutdown_connections 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- 172.21.15.12:0/1465896981 wait complete. 2024-04-26T18:04:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.373+0000 7f8c951ce740 1 -- start start 2024-04-26T18:04:35.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 Processor -- start 2024-04-26T18:04:35.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb7f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb49a10 0x5563fcb8bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1fe5b0 con 0x5563fcb879b0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ff290 con 0x5563fcb49a10 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.374+0000 7f8c951ce740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8c1febf0 con 0x5563fcb484b0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c951ce740 10 client.0 _ll_register_callbacks cb 0x7f8c7c001cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54244/0 (socket says 172.21.15.12:54244) 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 -- 172.21.15.12:0/943749905 learned_addr learned my addr 172.21.15.12:0/943749905 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c8b7fe640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb49a10 0x5563fcb8bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb7f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 -- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 msgr2=0x5563fcb7f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb7f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 -- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb49a10 msgr2=0x5563fcb8bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:04:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb49a10 0x5563fcb8bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 -- 172.21.15.12:0/943749905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563fcb7f5e0 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb7f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c9097f640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c84034040 tx=0x7f8c8402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c77fb04203470c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c6affd640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8404e060 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f8c8403eb30 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c740626f0 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f8c84054050 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c951ce740 10 client.5049 fetch_fsmap learned FSMap version 9 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.375+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5563fcb6fda0 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c740626f0 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f8c84057020 con 0x5563fcb879b0 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 10 client.5049 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:04:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 10 client.5049 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 20 client.5049 populate_metadata read hostname 'smithi012' 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb84a80 0x5563fcb84e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 4 client.5049 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e7b48494", "release": true, "await": true}] 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e7b48494", "release": true, "await": true}) -- 0x5563fcabac50 con 0x5563fcb84a80 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb84a80 0x5563fcb84e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c6affd640 10 client.5049 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.376+0000 7f8c8bfff640 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb84a80 0x5563fcb84e90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ba2fd35a4e253f server_cookie=32da7a977fe3adc1 in_seq=0 out_seq=0 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c6affd640 1 -- 172.21.15.12:0/943749905 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5563fcabac50 con 0x5563fcb84a80 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c6affd640 10 client.5049 handle_command_reply: tid=0 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 client.5049 shutdown 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 msgr2=0x5563fcb8c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c84034040 tx=0x7f8c8402c000 comp rx=0 tx=0).stop 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 shutdown_connections 2024-04-26T18:04:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5563fcb879b0 0x5563fcb8c410 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5563fcb84a80 0x5563fcb84e90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5563fcb49a10 0x5563fcb8bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 --2- 172.21.15.12:0/943749905 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5563fcb484b0 0x5563fcb7f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 >> 172.21.15.12:0/943749905 conn(0x5563fcb0f930 msgr2=0x5563fcb68850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c6affd640 0 client.5049 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 shutdown_connections 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 1 -- 172.21.15.12:0/943749905 wait complete. 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.377+0000 7f8c951ce740 20 client.5049 trim_cache size 0 max 16384 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:04:35.384 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 20, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "e7b48494": { 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 20, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 91.7, 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:04:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:04:35.386 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 msgr2=0x7f8c6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c0016e0 tx=0x7f8c7c009040 comp rx=0 tx=0).stop 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 msgr2=0x7f8c8c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400d860 tx=0x7f8c7400dd20 comp rx=0 tx=0).stop 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 shutdown_connections 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8c6c06c8f0 0x7f8c6c06edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8c8c156010 0x7f8c8c1f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c8c0c8db0 0x7f8c8c0cc530 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 --2- 172.21.15.12:0/384981953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8c8c0c8680 0x7f8c8c1f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:04:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 >> 172.21.15.12:0/384981953 conn(0x7f8c8c06eaf0 msgr2=0x7f8c8c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:04:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 shutdown_connections 2024-04-26T18:04:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:04:35.378+0000 7f8c923e2640 1 -- 172.21.15.12:0/384981953 wait complete. 2024-04-26T18:04:35.390 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e7b48494', seconds elapsed: 32.8 2024-04-26T18:04:35.548 INFO:tasks.workunit.client.0.smithi012.stderr:error: RPC failed; curl 56 OpenSSL SSL_read: error:0A000126:SSL routines::unexpected eof while reading, errno 0 2024-04-26T18:04:35.548 INFO:tasks.workunit.client.0.smithi012.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2024-04-26T18:04:35.549 INFO:tasks.workunit.client.0.smithi012.stderr:fatal: early EOF 2024-04-26T18:04:35.552 INFO:tasks.workunit.client.0.smithi012.stderr:fatal: fetch-pack: invalid index-pack output 2024-04-26T18:04:36.329 INFO:tasks.workunit.client.0.smithi012.stderr:+ retry 2024-04-26T18:04:36.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf ceph 2024-04-26T18:04:36.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ timeout 3600 git clone https://git.ceph.com/ceph.git 2024-04-26T18:04:36.334 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into 'ceph'... 2024-04-26T18:04:45.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:04:45.072 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:15.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:15.263 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:34.262 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.7 2024-04-26T18:05:34.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:05:34.418 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.418+0000 7f1155274640 1 Processor -- start 2024-04-26T18:05:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.418+0000 7f1155274640 1 -- start start 2024-04-26T18:05:34.419 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.419+0000 7f1155274640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1150155fa0 0x7f115015feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.419+0000 7f1155274640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11500ccd60 con 0x7f11500cc4f0 2024-04-26T18:05:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.419+0000 7f1155274640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f115015c0c0 con 0x7f11500cc8f0 2024-04-26T18:05:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.419+0000 7f1155274640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f115015c3a0 con 0x7f1150155fa0 2024-04-26T18:05:34.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1150155fa0 0x7f115015feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1150155fa0 0x7f115015feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58896/0 (socket says 172.21.15.12:58896) 2024-04-26T18:05:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 -- 172.21.15.12:0/991300207 learned_addr learned my addr 172.21.15.12:0/991300207 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114e7fc640 1 -- 172.21.15.12:0/991300207 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206261809 0 0) 0x7f115015c0c0 con 0x7f11500cc8f0 2024-04-26T18:05:34.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114e7fc640 1 -- 172.21.15.12:0/991300207 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f113c003520 con 0x7f11500cc8f0 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 -- 172.21.15.12:0/991300207 >> v1:172.21.15.100:6789/0 conn(0x7f11500cc8f0 legacy=0x7f11500b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 -- 172.21.15.12:0/991300207 >> v1:172.21.15.12:6789/0 conn(0x7f11500cc4f0 legacy=0x7f11500cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.420+0000 7f114effd640 1 -- 172.21.15.12:0/991300207 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115015c680 con 0x7f1150155fa0 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.421+0000 7f114effd640 1 --2- 172.21.15.12:0/991300207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f115015feb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1140009870 tx=0x7f114002a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b1e61de42eea16 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.421+0000 7f114e7fc640 1 -- 172.21.15.12:0/991300207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140037070 con 0x7f1150155fa0 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.421+0000 7f114e7fc640 1 -- 172.21.15.12:0/991300207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1140032640 con 0x7f1150155fa0 2024-04-26T18:05:34.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.421+0000 7f114e7fc640 1 -- 172.21.15.12:0/991300207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140032a10 con 0x7f1150155fa0 2024-04-26T18:05:34.423 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 -- 172.21.15.12:0/991300207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 msgr2=0x7f115015feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 --2- 172.21.15.12:0/991300207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f115015feb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1140009870 tx=0x7f114002a3c0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 -- 172.21.15.12:0/991300207 shutdown_connections 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 --2- 172.21.15.12:0/991300207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f115015feb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 -- 172.21.15.12:0/991300207 >> 172.21.15.12:0/991300207 conn(0x7f1150068090 msgr2=0x7f11500684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.422+0000 7f1155274640 1 -- 172.21.15.12:0/991300207 shutdown_connections 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.423+0000 7f1155274640 1 -- 172.21.15.12:0/991300207 wait complete. 2024-04-26T18:05:34.424 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.424+0000 7f1155274640 1 Processor -- start 2024-04-26T18:05:34.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.425+0000 7f1155274640 1 -- start start 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 0x7f11501f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11500cc8f0 0x7f11501540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f115015bd90 con 0x7f1150155fa0 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f115015cc40 con 0x7f11500cc4f0 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f1155274640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f1150156380 con 0x7f11500cc8f0 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58910/0 (socket says 172.21.15.12:58910) 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114f7fe640 1 -- 172.21.15.12:0/1077586329 learned_addr learned my addr 172.21.15.12:0/1077586329 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 0x7f11501f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f11467fc640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11500cc8f0 0x7f11501540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 -- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11500cc8f0 msgr2=0x7f11501540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11500cc8f0 0x7f11501540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 -- 172.21.15.12:0/1077586329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 msgr2=0x7f11501545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114effd640 1 -- 172.21.15.12:0/1077586329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11501f2b80 con 0x7f11500cc4f0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.426+0000 7f114f7fe640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f114effd640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 0x7f11501f2640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1140031000 tx=0x7f11400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140041070 con 0x7f11500cc4f0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1140004020 con 0x7f11500cc4f0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11501538f0 con 0x7f11500cc4f0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140037040 con 0x7f11500cc4f0 2024-04-26T18:05:34.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.427+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1150152af0 con 0x7f11500cc4f0 2024-04-26T18:05:34.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.428+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1150069ae0 con 0x7f11500cc4f0 2024-04-26T18:05:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.429+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1140030770 con 0x7f11500cc4f0 2024-04-26T18:05:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.430+0000 7f1147fff640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.430+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f11400ac5c0 con 0x7f11500cc4f0 2024-04-26T18:05:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.430+0000 7f11467fc640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:34.432 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.431+0000 7f11467fc640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 0x7f113006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f115015b8e0 tx=0x7f1138009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:34.435 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.435+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1140079f50 con 0x7f11500cc4f0 2024-04-26T18:05:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.896+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1150076d20 con 0x7f11500cc4f0 2024-04-26T18:05:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.897+0000 7f1147fff640 1 -- 172.21.15.12:0/1077586329 <== mon.1 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f114007e250 con 0x7f11500cc4f0 2024-04-26T18:05:34.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:05:34.897 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:05:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:05:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.899+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 msgr2=0x7f113006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.899+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 0x7f113006edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f115015b8e0 tx=0x7f1138009040 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.899+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 msgr2=0x7f11501f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.899+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 0x7f11501f2640 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1140031000 tx=0x7f11400046c0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 shutdown_connections 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1150155fa0 0x7f11501545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f113006c8f0 0x7f113006edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f11500cc8f0 0x7f11501540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 --2- 172.21.15.12:0/1077586329 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f11500cc4f0 0x7f11501f2640 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 >> 172.21.15.12:0/1077586329 conn(0x7f1150068090 msgr2=0x7f11500cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 shutdown_connections 2024-04-26T18:05:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:34.900+0000 7f1155274640 1 -- 172.21.15.12:0/1077586329 wait complete. 2024-04-26T18:05:34.916 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0' 2024-04-26T18:05:34.916 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0 2024-04-26T18:05:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.049+0000 7f379095f640 1 Processor -- start 2024-04-26T18:05:35.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.050+0000 7f379095f640 1 -- start start 2024-04-26T18:05:35.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f379095f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f378c154380 0x7f378c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f379095f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c15d3a0 con 0x7f378c0c6180 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f379095f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f378c15d680 con 0x7f378c153fa0 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f379095f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f378c15d960 con 0x7f378c154380 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f378ad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f378c0c6180 0x7f378c15a130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43646/0 (socket says 172.21.15.12:43646) 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f378ad9d640 1 -- 172.21.15.12:0/2174828927 learned_addr learned my addr 172.21.15.12:0/2174828927 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2174828927 >> v2:172.21.15.100:3300/0 conn(0x7f378c154380 0x7f378c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f378959a640 1 -- 172.21.15.12:0/2174828927 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181035599 0 0) 0x7f378c15d3a0 con 0x7f378c0c6180 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f378959a640 1 -- 172.21.15.12:0/2174828927 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3774003520 con 0x7f378c0c6180 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f3789d9b640 1 -- 172.21.15.12:0/2174828927 >> v1:172.21.15.100:6789/0 conn(0x7f378c153fa0 legacy=0x7f378c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f3789d9b640 1 -- 172.21.15.12:0/2174828927 >> v1:172.21.15.12:6789/0 conn(0x7f378c0c6180 legacy=0x7f378c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.051+0000 7f3789d9b640 1 -- 172.21.15.12:0/2174828927 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c15dc40 con 0x7f378c154380 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.052+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2174828927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c154380 0x7f378c071ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37800097a0 tx=0x7f378002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d04f91a46e8aad37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.052+0000 7f378959a640 1 -- 172.21.15.12:0/2174828927 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780037070 con 0x7f378c154380 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.052+0000 7f378959a640 1 -- 172.21.15.12:0/2174828927 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3780032440 con 0x7f378c154380 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.052+0000 7f378959a640 1 -- 172.21.15.12:0/2174828927 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37800327f0 con 0x7f378c154380 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.053+0000 7f379095f640 1 -- 172.21.15.12:0/2174828927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c154380 msgr2=0x7f378c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.053+0000 7f379095f640 1 --2- 172.21.15.12:0/2174828927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c154380 0x7f378c071ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f37800097a0 tx=0x7f378002a1e0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.053+0000 7f379095f640 1 -- 172.21.15.12:0/2174828927 shutdown_connections 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.053+0000 7f379095f640 1 --2- 172.21.15.12:0/2174828927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c154380 0x7f378c071ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.053+0000 7f379095f640 1 -- 172.21.15.12:0/2174828927 >> 172.21.15.12:0/2174828927 conn(0x7f378c0767e0 msgr2=0x7f378c070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.054+0000 7f379095f640 1 -- 172.21.15.12:0/2174828927 shutdown_connections 2024-04-26T18:05:35.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.054+0000 7f379095f640 1 -- 172.21.15.12:0/2174828927 wait complete. 2024-04-26T18:05:35.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.055+0000 7f379095f640 1 Processor -- start 2024-04-26T18:05:35.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.055+0000 7f379095f640 1 -- start start 2024-04-26T18:05:35.058 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.056+0000 7f379095f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 0x7f378c158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.056+0000 7f379095f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.056+0000 7f3789d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f3789d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58920/0 (socket says 172.21.15.12:58920) 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f3789d9b640 1 -- 172.21.15.12:0/1178668255 learned_addr learned my addr 172.21.15.12:0/1178668255 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c1f23c0 0x7f378c149a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 0x7f378c158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f378c15a840 con 0x7f378c153fa0 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f378c0702b0 con 0x7f378c1f23c0 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f378c15a9c0 con 0x7f378c0c6180 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c1f23c0 0x7f378c149a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 -- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c1f23c0 msgr2=0x7f378c149a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c1f23c0 0x7f378c149a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 -- 172.21.15.12:0/1178668255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 msgr2=0x7f378c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f378a59c640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f378c0cb000 con 0x7f378c0c6180 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.057+0000 7f3789d9b640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.058+0000 7f378a59c640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 0x7f378c158df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c410 tx=0x7f377c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.058+0000 7f377affd640 1 -- 172.21.15.12:0/1178668255 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c017070 con 0x7f378c0c6180 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.058+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f378c1f2890 con 0x7f378c0c6180 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.058+0000 7f377affd640 1 -- 172.21.15.12:0/1178668255 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c0035f0 con 0x7f378c0c6180 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.058+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f378c0cb580 con 0x7f378c0c6180 2024-04-26T18:05:35.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.059+0000 7f377affd640 1 -- 172.21.15.12:0/1178668255 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c003a20 con 0x7f378c0c6180 2024-04-26T18:05:35.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.061+0000 7f3793674740 1 Processor -- start 2024-04-26T18:05:35.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.061+0000 7f377affd640 1 -- 172.21.15.12:0/1178668255 <== mon.2 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f377c003bc0 con 0x7f378c0c6180 2024-04-26T18:05:35.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.061+0000 7f3793674740 1 -- start start 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f377affd640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 0x7f376c06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f377affd640 1 -- 172.21.15.12:0/1178668255 <== mon.2 v2:172.21.15.100:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f377c0037e0 con 0x7f378c0c6180 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 0x7f376c06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x5637959639c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x563795963f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x5637958c6d80 con 0x5637959a2ae0 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563795862c20 con 0x563795964b40 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x5637958c2d40 con 0x5637959635e0 2024-04-26T18:05:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x563795963f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f378a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f378a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:35354/0 (socket says 172.21.15.12:35354) 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f378a59c640 1 -- 172.21.15.12:0/3838147703 learned_addr learned my addr 172.21.15.12:0/3838147703 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.062+0000 7f3789d9b640 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x5637959639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 0x7f376c06efe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3784005c00 tx=0x7f3784012620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 -- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 msgr2=0x563795963f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x563795963f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 -- 172.21.15.12:0/3838147703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 msgr2=0x5637959639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x5637959639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 -- 172.21.15.12:0/3838147703 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637956a4d80 con 0x5637959635e0 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f3789d9b640 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x5637959639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:05:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f378a59c640 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f377c007fd0 tx=0x7f377c0584e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97117b9b9d8794c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f376bfff640 1 -- 172.21.15.12:0/3838147703 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c061580 con 0x5637959635e0 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f376bfff640 1 -- 172.21.15.12:0/3838147703 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c056d50 con 0x5637959635e0 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.063+0000 7f376bfff640 1 -- 172.21.15.12:0/3838147703 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c05f070 con 0x5637959635e0 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 -- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 msgr2=0x5637959a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f377c007fd0 tx=0x7f377c0584e0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 -- 172.21.15.12:0/3838147703 shutdown_connections 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x563795963f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x5637959639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 --2- 172.21.15.12:0/3838147703 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x5637959a25a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 -- 172.21.15.12:0/3838147703 >> 172.21.15.12:0/3838147703 conn(0x56379592a740 msgr2=0x5637959a7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 -- 172.21.15.12:0/3838147703 shutdown_connections 2024-04-26T18:05:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.064+0000 7f3793674740 1 -- 172.21.15.12:0/3838147703 wait complete. 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.065+0000 7f3793674740 1 -- start start 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.065+0000 7f3793674740 1 Processor -- start 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563795964b40 0x56379599b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x56379599ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x563795961c20 con 0x5637959635e0 2024-04-26T18:05:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x563795860840 con 0x5637959a2ae0 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x563795965170 con 0x563795964b40 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f3793674740 10 client.0 _ll_register_callbacks cb 0x5637958645b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58936/0 (socket says 172.21.15.12:58936) 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 -- 172.21.15.12:0/957312048 learned_addr learned my addr 172.21.15.12:0/957312048 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 -- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563795964b40 msgr2=0x56379599b540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563795964b40 0x56379599b540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 -- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 msgr2=0x56379599ba80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x56379599ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 -- 172.21.15.12:0/957312048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563795705510 con 0x5637959635e0 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.066+0000 7f378a59c640 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cd10 tx=0x7f377c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38357be19e162d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c075070 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f377c0580a0 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f377c056d50 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f377c05f280 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 10 client.5070 fetch_fsmap learned FSMap version 9 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x563795598670 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c056d50 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f377c076b00 con 0x5637959635e0 2024-04-26T18:05:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 10 client.5070 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 10 client.5070 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 20 client.5070 populate_metadata read hostname 'smithi012' 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x56379598b400 0x5637959b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 4 client.5070 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.067+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637958d4990 con 0x56379598b400 2024-04-26T18:05:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.068+0000 7f3789d9b640 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x56379598b400 0x5637959b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.068+0000 7f37697fa640 10 client.5070 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.068+0000 7f3789d9b640 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x56379598b400 0x5637959b74d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b30292d812ec4 server_cookie=df00b637537687c7 in_seq=0 out_seq=0 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f37697fa640 1 -- 172.21.15.12:0/957312048 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5637958d4990 con 0x56379598b400 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f37697fa640 10 client.5070 handle_command_reply: tid=0 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 client.5070 shutdown 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 msgr2=0x56379599da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f377c00cd10 tx=0x7f377c007f40 comp rx=0 tx=0).stop 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 shutdown_connections 2024-04-26T18:05:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x56379598b400 0x5637959b74d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x56379599ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x563795964b40 0x56379599b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f37697fa640 0 client.5070 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 --2- 172.21.15.12:0/957312048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959635e0 0x56379599da90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 >> 172.21.15.12:0/957312048 conn(0x56379592a740 msgr2=0x56379598c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 shutdown_connections 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 1 -- 172.21.15.12:0/957312048 wait complete. 2024-04-26T18:05:35.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.069+0000 7f3793674740 20 client.5070 trim_cache size 0 max 16384 2024-04-26T18:05:35.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.087+0000 7f3793674740 1 Processor -- start 2024-04-26T18:05:35.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.087+0000 7f3793674740 1 -- start start 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x56379599c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x56379599c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f378c1fc210 con 0x5637959a2ae0 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f378c157910 con 0x563795964b40 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f378c155ea0 con 0x5637959635e0 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f378ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58938/0 (socket says 172.21.15.12:58938) 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f378ad9d640 1 -- 172.21.15.12:0/1390190564 learned_addr learned my addr 172.21.15.12:0/1390190564 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f378a59c640 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x56379599c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.088+0000 7f3789d9b640 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x56379599c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 -- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 msgr2=0x56379599c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x56379599c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 -- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 msgr2=0x56379599c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x56379599c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 -- 172.21.15.12:0/1390190564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56379598d2f0 con 0x5637959a2ae0 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f378ad9d640 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3784016620 tx=0x7f3784016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eb139a98fd66d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f376b7fe640 1 -- 172.21.15.12:0/1390190564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784026070 con 0x5637959a2ae0 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f376b7fe640 1 -- 172.21.15.12:0/1390190564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37840071d0 con 0x5637959a2ae0 2024-04-26T18:05:35.092 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.089+0000 7f376b7fe640 1 -- 172.21.15.12:0/1390190564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3784007580 con 0x5637959a2ae0 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- 172.21.15.12:0/1390190564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 msgr2=0x56379595ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3784016620 tx=0x7f3784016000 comp rx=0 tx=0).stop 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- 172.21.15.12:0/1390190564 shutdown_connections 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5637959a2ae0 0x56379595ea20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x563795964b40 0x56379599c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 --2- 172.21.15.12:0/1390190564 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x56379599c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- 172.21.15.12:0/1390190564 >> 172.21.15.12:0/1390190564 conn(0x56379592a740 msgr2=0x5637959c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- 172.21.15.12:0/1390190564 shutdown_connections 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- 172.21.15.12:0/1390190564 wait complete. 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.090+0000 7f3793674740 1 -- start start 2024-04-26T18:05:35.093 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.091+0000 7f3793674740 1 Processor -- start 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.091+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.091+0000 7f3793674740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 0x563795a1d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3793674740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x5637959bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3793674740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f378c1564a0 con 0x563795964b40 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f378c157240 con 0x5637959a2ae0 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3793674740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f378c156b70 con 0x5637959635e0 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3793674740 10 client.0 _ll_register_callbacks cb 0x7f3784001e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:35382/0 (socket says 172.21.15.12:35382) 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 -- 172.21.15.12:0/2675095374 learned_addr learned my addr 172.21.15.12:0/2675095374 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 0x563795a1d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378ad9d640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x5637959bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 -- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 msgr2=0x5637959bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x5637959bd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 -- 172.21.15.12:0/2675095374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 msgr2=0x563795a1d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 0x563795a1d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 -- 172.21.15.12:0/2675095374 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x563795a1dd80 con 0x5637959635e0 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 0x563795a1d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f378a59c640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f377c058750 tx=0x7f377c054cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c8748c7f96402b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:05:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.092+0000 7f37697fa640 10 client.0 ms_handle_connect on v2:172.21.15.100:3301/0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f377c075070 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mon.2 v2:172.21.15.100:3301/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f377c054a50 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37840071d0 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f377c058a50 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 10 client.4766 fetch_fsmap learned FSMap version 9 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5637959c8050 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mon.2 v2:172.21.15.100:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f377c057ea0 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mon.2 v2:172.21.15.100:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f377c058050 con 0x5637959635e0 2024-04-26T18:05:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 10 client.4766 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 10 client.4766 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 20 client.4766 populate_metadata read hostname 'smithi012' 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5637959bd5c0 0x5637959bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 4 client.4766 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}] 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.093+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}) -- 0x7f37840071d0 con 0x5637959bd5c0 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.094+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5637959bd5c0 0x5637959bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.095+0000 7f37697fa640 10 client.4766 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:05:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.095+0000 7f3789d9b640 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5637959bd5c0 0x5637959bd9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18903daa69406da2 server_cookie=5fcb281ba64154f4 in_seq=0 out_seq=0 2024-04-26T18:05:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.111+0000 7f37697fa640 1 -- 172.21.15.12:0/2675095374 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x7f37840071d0 con 0x5637959bd5c0 2024-04-26T18:05:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.111+0000 7f37697fa640 10 client.4766 handle_command_reply: tid=0 2024-04-26T18:05:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.111+0000 7f3793674740 1 client.4766 shutdown 2024-04-26T18:05:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.111+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 msgr2=0x563795989db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.111+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f377c058750 tx=0x7f377c054cf0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 shutdown_connections 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x5637959bd5c0 0x5637959bd9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5637959a2ae0 0x5637959bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563795964b40 0x563795a1d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f37697fa640 0 client.4766 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 --2- 172.21.15.12:0/2675095374 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x5637959635e0 0x563795989db0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 >> 172.21.15.12:0/2675095374 conn(0x56379592a740 msgr2=0x56379599c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 shutdown_connections 2024-04-26T18:05:35.114 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 1 -- 172.21.15.12:0/2675095374 wait complete. 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f3793674740 20 client.4766 trim_cache size 0 max 16384 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 22, 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "832935a0": { 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 22, 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:05:35.115 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 89.7, 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:05:35.116 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:05:35.117 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:05:35.117 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:05:35.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 msgr2=0x7f376c06efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 0x7f376c06efe0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3784005c00 tx=0x7f3784012620 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 msgr2=0x7f378c158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.112+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 0x7f378c158df0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f377c00c410 tx=0x7f377c00c810 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 shutdown_connections 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f378c1f23c0 0x7f378c149a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378c153fa0 0x7f378c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f376c06cb20 0x7f376c06efe0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 --2- 172.21.15.12:0/1178668255 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f378c0c6180 0x7f378c158df0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 >> 172.21.15.12:0/1178668255 conn(0x7f378c0767e0 msgr2=0x7f378c14fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 shutdown_connections 2024-04-26T18:05:35.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:05:35.113+0000 7f379095f640 1 -- 172.21.15.12:0/1178668255 wait complete. 2024-04-26T18:05:35.125 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '832935a0', quiesce took 0.9 seconds. Will release after: 29.7 2024-04-26T18:05:45.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:05:45.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:04.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:06:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.942+0000 7f3614f5f640 1 Processor -- start 2024-04-26T18:06:04.941 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.942+0000 7f3614f5f640 1 -- start start 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f3614f5f640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36100ca2c0 0x7f3610158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f3614f5f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36100725c0 con 0x7f36101521f0 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f3614f5f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f361015b7e0 con 0x7f3610072f00 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f3614f5f640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f361015c5a0 con 0x7f36100ca2c0 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f360ed9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f36100ca2c0 0x7f3610158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f360e59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f36101521f0 0x7f36100c7ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40948/0 (socket says 172.21.15.12:40948) 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.943+0000 7f360e59c640 1 -- 172.21.15.12:0/1335609614 learned_addr learned my addr 172.21.15.12:0/1335609614 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.944+0000 7f360ed9d640 1 -- 172.21.15.12:0/1335609614 >> v1:172.21.15.100:6789/0 conn(0x7f3610072f00 legacy=0x7f36100c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.944+0000 7f360ed9d640 1 -- 172.21.15.12:0/1335609614 >> v1:172.21.15.12:6789/0 conn(0x7f36101521f0 legacy=0x7f36100c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.944+0000 7f360ed9d640 1 -- 172.21.15.12:0/1335609614 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f361015bac0 con 0x7f36100ca2c0 2024-04-26T18:06:04.943 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.944+0000 7f360d59a640 1 -- 172.21.15.12:0/1335609614 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757601071 0 0) 0x7f36100725c0 con 0x7f36101521f0 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.944+0000 7f360ed9d640 1 --2- 172.21.15.12:0/1335609614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36100ca2c0 0x7f3610158a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3600009d90 tx=0x7f360002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216bc02ecc7dfe85 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f360d59a640 1 -- 172.21.15.12:0/1335609614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600007740 con 0x7f36100ca2c0 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f360d59a640 1 -- 172.21.15.12:0/1335609614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36000078e0 con 0x7f36100ca2c0 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f360d59a640 1 -- 172.21.15.12:0/1335609614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600007cb0 con 0x7f36100ca2c0 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 -- 172.21.15.12:0/1335609614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36100ca2c0 msgr2=0x7f3610158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 --2- 172.21.15.12:0/1335609614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36100ca2c0 0x7f3610158a60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3600009d90 tx=0x7f360002a6f0 comp rx=0 tx=0).stop 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 -- 172.21.15.12:0/1335609614 shutdown_connections 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 --2- 172.21.15.12:0/1335609614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36100ca2c0 0x7f3610158a60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 -- 172.21.15.12:0/1335609614 >> 172.21.15.12:0/1335609614 conn(0x7f3610068270 msgr2=0x7f3610068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:04.945 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 -- 172.21.15.12:0/1335609614 shutdown_connections 2024-04-26T18:06:04.946 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.945+0000 7f3614f5f640 1 -- 172.21.15.12:0/1335609614 wait complete. 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 Processor -- start 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 -- start start 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3610072f00 0x7f36100cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36100ca2c0 0x7f3610134830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f36100c85d0 con 0x7f36101521f0 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f361015c110 con 0x7f3610072f00 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f3614f5f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f36101456e0 con 0x7f36100ca2c0 2024-04-26T18:06:04.948 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f360ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f360ed9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37484/0 (socket says 172.21.15.12:37484) 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f360ed9d640 1 -- 172.21.15.12:0/385735378 learned_addr learned my addr 172.21.15.12:0/385735378 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.947+0000 7f360e59c640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3610072f00 0x7f36100cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360dd9b640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36100ca2c0 0x7f3610134830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 -- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36100ca2c0 msgr2=0x7f3610134830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36100ca2c0 0x7f3610134830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 -- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3610072f00 msgr2=0x7f36100cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3610072f00 0x7f36100cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 -- 172.21.15.12:0/385735378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101f3150 con 0x7f36101521f0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f360ed9d640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3600009eb0 tx=0x7f3600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600040070 con 0x7f36101521f0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3600031c40 con 0x7f36101521f0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600003990 con 0x7f36101521f0 2024-04-26T18:06:04.949 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101f3430 con 0x7f36101521f0 2024-04-26T18:06:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.948+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36100cc670 con 0x7f36101521f0 2024-04-26T18:06:04.950 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.949+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36101f2f70 con 0x7f36101521f0 2024-04-26T18:06:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.950+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3600039040 con 0x7f36101521f0 2024-04-26T18:06:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.950+0000 7f35feffd640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 0x7f35f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.950+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f36000ad360 con 0x7f36101521f0 2024-04-26T18:06:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.950+0000 7f360e59c640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 0x7f35f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:04.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.951+0000 7f360e59c640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 0x7f35f006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3608007f70 tx=0x7f3608007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:04.955+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36101f2f70 con 0x7f36101521f0 2024-04-26T18:06:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.180+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3610076d20 con 0x7f36101521f0 2024-04-26T18:06:05.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.181+0000 7f35feffd640 1 -- 172.21.15.12:0/385735378 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f360007ac70 con 0x7f36101521f0 2024-04-26T18:06:05.180 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:06:05.181 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:06:05.181 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:06:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 msgr2=0x7f35f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 0x7f35f006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3608007f70 tx=0x7f3608007f00 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 msgr2=0x7f36101328b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3600009eb0 tx=0x7f3600004a40 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 shutdown_connections 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f36101521f0 0x7f36101328b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f35f006c8f0 0x7f35f006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f36100ca2c0 0x7f3610134830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 --2- 172.21.15.12:0/385735378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3610072f00 0x7f36100cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 >> 172.21.15.12:0/385735378 conn(0x7f3610068270 msgr2=0x7f36100c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 shutdown_connections 2024-04-26T18:06:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.183+0000 7f3614f5f640 1 -- 172.21.15.12:0/385735378 wait complete. 2024-04-26T18:06:05.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 832935a0 --release --await' 2024-04-26T18:06:05.194 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 832935a0 --release --await 2024-04-26T18:06:05.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.302+0000 7f13c6ae1640 1 Processor -- start 2024-04-26T18:06:05.302 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.302+0000 7f13c6ae1640 1 -- start start 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c6ae1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13c00d1320 0x7f13c00d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c6ae1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13c00cc0e0 0x7f13c00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c6ae1640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c00cca70 con 0x7f13c01527f0 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c6ae1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f13c00c6780 con 0x7f13c00d1320 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c6ae1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f13c015cbc0 con 0x7f13c00cc0e0 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13bffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13c00d1320 0x7f13c00d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13bffff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f13c00d1320 0x7f13c00d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37494/0 (socket says 172.21.15.12:37494) 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13bffff640 1 -- 172.21.15.12:0/2150286134 learned_addr learned my addr 172.21.15.12:0/2150286134 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.303+0000 7f13c507e640 1 --2- 172.21.15.12:0/2150286134 >> v2:172.21.15.100:3300/0 conn(0x7f13c00cc0e0 0x7f13c00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.304 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bffff640 1 -- 172.21.15.12:0/2150286134 >> v2:172.21.15.100:3300/0 conn(0x7f13c00cc0e0 msgr2=0x7f13c00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bffff640 1 --2- 172.21.15.12:0/2150286134 >> v2:172.21.15.100:3300/0 conn(0x7f13c00cc0e0 0x7f13c00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bffff640 1 -- 172.21.15.12:0/2150286134 >> v1:172.21.15.100:6789/0 conn(0x7f13c01527f0 legacy=0x7f13c015f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bffff640 1 -- 172.21.15.12:0/2150286134 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c015c040 con 0x7f13c00d1320 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bffff640 1 --2- 172.21.15.12:0/2150286134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00d1320 0x7f13c00d17b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009850 tx=0x7f13b002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3cbc1ef1d2f0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bf7fe640 1 -- 172.21.15.12:0/2150286134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0004030 con 0x7f13c00d1320 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.304+0000 7f13bf7fe640 1 -- 172.21.15.12:0/2150286134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b00041d0 con 0x7f13c00d1320 2024-04-26T18:06:05.305 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13bf7fe640 1 -- 172.21.15.12:0/2150286134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0003610 con 0x7f13c00d1320 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 -- 172.21.15.12:0/2150286134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00d1320 msgr2=0x7f13c00d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/2150286134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00d1320 0x7f13c00d17b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f13b0009850 tx=0x7f13b002a230 comp rx=0 tx=0).stop 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 -- 172.21.15.12:0/2150286134 shutdown_connections 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/2150286134 >> v2:172.21.15.100:3300/0 conn(0x7f13c00cc0e0 0x7f13c00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/2150286134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00d1320 0x7f13c00d17b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 -- 172.21.15.12:0/2150286134 >> 172.21.15.12:0/2150286134 conn(0x7f13c0076100 msgr2=0x7f13c0073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 -- 172.21.15.12:0/2150286134 shutdown_connections 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.305+0000 7f13c6ae1640 1 -- 172.21.15.12:0/2150286134 wait complete. 2024-04-26T18:06:05.308 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.306+0000 7f13c6ae1640 1 Processor -- start 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.306+0000 7f13c6ae1640 1 -- start start 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 0x7f13c01f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 0x7f13c0158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015c8e0 con 0x7f13c00cc0e0 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13c015c600 con 0x7f13c01527f0 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c6ae1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00cdb00 con 0x7f13c00d1320 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37506/0 (socket says 172.21.15.12:37506) 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 -- 172.21.15.12:0/3251521930 learned_addr learned my addr 172.21.15.12:0/3251521930 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c507e640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 0x7f13c0158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.309 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13bffff640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 0x7f13c01f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 -- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 msgr2=0x7f13c01f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 0x7f13c01f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.307+0000 7f13c487d640 1 -- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 msgr2=0x7f13c0158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c487d640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 0x7f13c0158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c487d640 1 -- 172.21.15.12:0/3251521930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c01e92d0 con 0x7f13c00cc0e0 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13bffff640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 0x7f13c01f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c507e640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 0x7f13c0158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c487d640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13b800ba50 tx=0x7f13b800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13bd7fa640 1 -- 172.21.15.12:0/3251521930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8019070 con 0x7f13c00cc0e0 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13bd7fa640 1 -- 172.21.15.12:0/3251521930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b800cb60 con 0x7f13c00cc0e0 2024-04-26T18:06:05.310 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c01e9030 con 0x7f13c00cc0e0 2024-04-26T18:06:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13bd7fa640 1 -- 172.21.15.12:0/3251521930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8014440 con 0x7f13c00cc0e0 2024-04-26T18:06:05.311 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.308+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c01f5b00 con 0x7f13c00cc0e0 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.309+0000 7f13bd7fa640 1 -- 172.21.15.12:0/3251521930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f13b801c070 con 0x7f13c00cc0e0 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.310+0000 7f13bd7fa640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.310+0000 7f13bd7fa640 1 -- 172.21.15.12:0/3251521930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f13b808bae0 con 0x7f13c00cc0e0 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.310+0000 7f13bffff640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13bffff640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 0x7f13a006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13b0033000 tx=0x7f13b002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 Processor -- start 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 -- start start 2024-04-26T18:06:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd84802890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd84803a10 0x55cd84802dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cd84767040 con 0x55cd848024b0 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd84702b60 con 0x55cd848419b0 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.311+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55cd84763000 con 0x55cd84803a10 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37510/0 (socket says 172.21.15.12:37510) 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 -- 172.21.15.12:0/1267025427 learned_addr learned my addr 172.21.15.12:0/1267025427 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c507e640 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd84803a10 0x55cd84802dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.319 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13bffff640 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd84802890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 -- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd84803a10 msgr2=0x55cd84802dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd84803a10 0x55cd84802dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 -- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 msgr2=0x55cd84802890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd84802890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 -- 172.21.15.12:0/1267025427 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd846f79c0 con 0x55cd848024b0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13c487d640 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13b8061b10 tx=0x7f13b8059410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f2fa81426e0ebf server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13b67fc640 1 -- 172.21.15.12:0/1267025427 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8071020 con 0x55cd848024b0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13b67fc640 1 -- 172.21.15.12:0/1267025427 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8057810 con 0x55cd848024b0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.312+0000 7f13b67fc640 1 -- 172.21.15.12:0/1267025427 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8061bb0 con 0x55cd848024b0 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- 172.21.15.12:0/1267025427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 msgr2=0x55cd84841470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f13b8061b10 tx=0x7f13b8059410 comp rx=0 tx=0).stop 2024-04-26T18:06:05.320 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- 172.21.15.12:0/1267025427 shutdown_connections 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd84803a10 0x55cd84802dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd84802890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1267025427 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84841470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- 172.21.15.12:0/1267025427 >> 172.21.15.12:0/1267025427 conn(0x55cd847c9930 msgr2=0x55cd84846450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- 172.21.15.12:0/1267025427 shutdown_connections 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- 172.21.15.12:0/1267025427 wait complete. 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 -- start start 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.313+0000 7f13c97fe740 1 Processor -- start 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd8483f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84856240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.321 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55cd84800af0 con 0x55cd848419b0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55cd847004f0 con 0x55cd84803a10 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55cd84804040 con 0x55cd848024b0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c97fe740 10 client.0 _ll_register_callbacks cb 0x55cd8475dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c507e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c507e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37514/0 (socket says 172.21.15.12:37514) 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c507e640 1 -- 172.21.15.12:0/1473122264 learned_addr learned my addr 172.21.15.12:0/1473122264 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13c487d640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd8483f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.314+0000 7f13bffff640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84856240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 -- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 msgr2=0x55cd8483f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd8483f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.322 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 -- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 msgr2=0x55cd84856240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84856240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 -- 172.21.15.12:0/1473122264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd84478920 con 0x55cd848419b0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13bffff640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84856240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c507e640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13a800bfb0 tx=0x7f13a80116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f39c72b77a6963 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8019070 con 0x55cd848419b0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f13a8015650 con 0x55cd848419b0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b8057810 con 0x55cd848419b0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f13a8024050 con 0x55cd848419b0 2024-04-26T18:06:05.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 10 client.5097 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd84544d30 con 0x55cd848419b0 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8057810 con 0x55cd848419b0 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f13a8027020 con 0x55cd848419b0 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 10 client.5097 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 10 client.5097 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.315+0000 7f13c97fe740 20 client.5097 populate_metadata read hostname 'smithi012' 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd84856780 0x55cd848296e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f13c97fe740 4 client.5097 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd8473aa00 con 0x55cd84856780 2024-04-26T18:06:05.324 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f13c487d640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd84856780 0x55cd848296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f13c487d640 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd84856780 0x55cd848296e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f37e8e38a55fd1bb server_cookie=e7fcfd4c84c31db6 in_seq=0 out_seq=0 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.316+0000 7f139f7fe640 10 client.5097 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f139f7fe640 1 -- 172.21.15.12:0/1473122264 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cd8473aa00 con 0x55cd84856780 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f139f7fe640 10 client.5097 handle_command_reply: tid=0 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 client.5097 shutdown 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 msgr2=0x55cd8482c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13a800bfb0 tx=0x7f13a80116f0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 shutdown_connections 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848419b0 0x55cd8482c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd84856780 0x55cd848296e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84856240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.325 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 --2- 172.21.15.12:0/1473122264 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd8483f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f139f7fe640 0 client.5097 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:06:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 >> 172.21.15.12:0/1473122264 conn(0x55cd847c9930 msgr2=0x55cd8482bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 shutdown_connections 2024-04-26T18:06:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 1 -- 172.21.15.12:0/1473122264 wait complete. 2024-04-26T18:06:05.326 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.317+0000 7f13c97fe740 20 client.5097 trim_cache size 0 max 16384 2024-04-26T18:06:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 Processor -- start 2024-04-26T18:06:05.334 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 -- start start 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84802890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 0x55cd84802dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13c0200720 con 0x55cd848024b0 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13c01ff600 con 0x55cd84803a10 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f13c00b6b80 con 0x55cd848419b0 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c487d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37526/0 (socket says 172.21.15.12:37526) 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.335+0000 7f13c487d640 1 -- 172.21.15.12:0/310032616 learned_addr learned my addr 172.21.15.12:0/310032616 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c507e640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 0x55cd84802dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.341 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13bffff640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84802890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 -- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 msgr2=0x55cd84802dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 0x55cd84802dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 -- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 msgr2=0x55cd84802890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84802890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 -- 172.21.15.12:0/310032616 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd848565b0 con 0x55cd848024b0 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c507e640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 0x55cd84802dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13bffff640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84802890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c487d640 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13b8089cb0 tx=0x7f13b805c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c4a5aa0d9f3ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.342 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13b5ffb640 1 -- 172.21.15.12:0/310032616 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b8071040 con 0x55cd848024b0 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13b5ffb640 1 -- 172.21.15.12:0/310032616 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8055b80 con 0x55cd848024b0 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13b5ffb640 1 -- 172.21.15.12:0/310032616 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b80592e0 con 0x55cd848024b0 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c97fe740 1 -- 172.21.15.12:0/310032616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 msgr2=0x55cd84846bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.336+0000 7f13c97fe740 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13b8089cb0 tx=0x7f13b805c000 comp rx=0 tx=0).stop 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 -- 172.21.15.12:0/310032616 shutdown_connections 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848419b0 0x55cd84802dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd84803a10 0x55cd84802890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 --2- 172.21.15.12:0/310032616 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd848024b0 0x55cd84846bb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 -- 172.21.15.12:0/310032616 >> 172.21.15.12:0/310032616 conn(0x55cd847c9930 msgr2=0x55cd84845df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 -- 172.21.15.12:0/310032616 shutdown_connections 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 -- 172.21.15.12:0/310032616 wait complete. 2024-04-26T18:06:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 -- start start 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.337+0000 7f13c97fe740 1 Processor -- start 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd847fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd848b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f13c01fe190 con 0x55cd84803a10 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f13c01fef30 con 0x55cd848419b0 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f13c01fe860 con 0x55cd848024b0 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c97fe740 10 client.0 _ll_register_callbacks cb 0x7f13a800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37536/0 (socket says 172.21.15.12:37536) 2024-04-26T18:06:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 -- 172.21.15.12:0/413258256 learned_addr learned my addr 172.21.15.12:0/413258256 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c507e640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd848b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13c487d640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd847fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 -- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 msgr2=0x55cd847fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd847fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 -- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 msgr2=0x55cd848b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.338+0000 7f13bffff640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd848b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13bffff640 1 -- 172.21.15.12:0/413258256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd84839b90 con 0x55cd84803a10 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13bffff640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f13b00090b0 tx=0x7f13b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85fc071ab2bb78 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b004f070 con 0x55cd84803a10 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f13b0006790 con 0x55cd84803a10 2024-04-26T18:06:05.345 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13b8055b80 con 0x55cd84803a10 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f13b0049480 con 0x55cd84803a10 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 10 client.5103 fetch_fsmap learned FSMap version 9 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55cd84843330 con 0x55cd84803a10 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b8055b80 con 0x55cd84803a10 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f13b0046050 con 0x55cd84803a10 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 10 client.5103 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 10 client.5103 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 20 client.5103 populate_metadata read hostname 'smithi012' 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd848438d0 0x55cd848b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:06:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 4 client.5103 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "832935a0", "release": true, "await": true}] 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "832935a0", "release": true, "await": true}) -- 0x55cd84774c50 con 0x55cd848438d0 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.339+0000 7f13c487d640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd848438d0 0x55cd848b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f139f7fe640 10 client.5103 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c487d640 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd848438d0 0x55cd848b67d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2dd5946d8ae9cb8 server_cookie=27d8c3a770c7f117 in_seq=0 out_seq=0 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f139f7fe640 1 -- 172.21.15.12:0/413258256 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55cd84774c50 con 0x55cd848438d0 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f139f7fe640 10 client.5103 handle_command_reply: tid=0 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 client.5103 shutdown 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 msgr2=0x55cd8483ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f13b00090b0 tx=0x7f13b0004730 comp rx=0 tx=0).stop 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 shutdown_connections 2024-04-26T18:06:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55cd848438d0 0x55cd848b67d0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55cd848419b0 0x55cd848b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f139f7fe640 0 client.5103 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cd84803a10 0x55cd8483ebd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 --2- 172.21.15.12:0/413258256 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55cd848024b0 0x55cd847fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.340+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 >> 172.21.15.12:0/413258256 conn(0x55cd847c9930 msgr2=0x55cd84866640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 shutdown_connections 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c97fe740 1 -- 172.21.15.12:0/413258256 wait complete. 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c97fe740 20 client.5103 trim_cache size 0 max 16384 2024-04-26T18:06:05.348 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 24, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "832935a0": { 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 24, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:06:05.349 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 89.7, 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:06:05.350 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:06:05.351 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 msgr2=0x7f13a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 0x7f13a006edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13b0033000 tx=0x7f13b002e000 comp rx=0 tx=0).stop 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 msgr2=0x7f13c00b5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f13b800ba50 tx=0x7f13b800bf10 comp rx=0 tx=0).stop 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 shutdown_connections 2024-04-26T18:06:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13c01527f0 0x7f13c0158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f13a006c8f0 0x7f13a006edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f13c00d1320 0x7f13c01f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 --2- 172.21.15.12:0/3251521930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13c00cc0e0 0x7f13c00b5750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 >> 172.21.15.12:0/3251521930 conn(0x7f13c0076100 msgr2=0x7f13c0159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 shutdown_connections 2024-04-26T18:06:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:06:05.341+0000 7f13c6ae1640 1 -- 172.21.15.12:0/3251521930 wait complete. 2024-04-26T18:06:05.353 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '832935a0', seconds elapsed: 31.1 2024-04-26T18:06:15.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:15.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:45.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:06:45.501 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:00.511 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-26T18:07:00.511 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-04-26T18:07:00.512 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.618+0000 7f75d9319640 1 Processor -- start 2024-04-26T18:07:00.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.618+0000 7f75d9319640 1 -- start start 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d9319640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f75d4152cb0 0x7f75d415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d9319640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d40c89f0 0x7f75d40c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d9319640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d40736a0 con 0x7f75d40c7c20 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d9319640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f75d40c62e0 con 0x7f75d4152cb0 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d9319640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f75d4073940 con 0x7f75d40c89f0 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d2ffd640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f75d4152cb0 0x7f75d415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d37fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f75d40c7c20 0x7f75d40cd460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51282/0 (socket says 172.21.15.12:51282) 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d37fe640 1 -- 172.21.15.12:0/2534379441 learned_addr learned my addr 172.21.15.12:0/2534379441 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d27fc640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d40c89f0 0x7f75d40c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d2ffd640 1 -- 172.21.15.12:0/2534379441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d40c89f0 msgr2=0x7f75d40c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d2ffd640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d40c89f0 0x7f75d40c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d2ffd640 1 -- 172.21.15.12:0/2534379441 >> v1:172.21.15.12:6789/0 conn(0x7f75d40c7c20 legacy=0x7f75d40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d1ffb640 1 -- 172.21.15.12:0/2534379441 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110321105 0 0) 0x7f75d40736a0 con 0x7f75d40c7c20 2024-04-26T18:07:00.621 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.619+0000 7f75d2ffd640 1 -- 172.21.15.12:0/2534379441 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d40c48c0 con 0x7f75d4152cb0 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.620+0000 7f75d2ffd640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d4152cb0 0x7f75d415bd50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849f93d77eca5660 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.620+0000 7f75d1ffb640 1 -- 172.21.15.12:0/2534379441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc037070 con 0x7f75d4152cb0 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.620+0000 7f75d1ffb640 1 -- 172.21.15.12:0/2534379441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc032440 con 0x7f75d4152cb0 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.620+0000 7f75d1ffb640 1 -- 172.21.15.12:0/2534379441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc032810 con 0x7f75d4152cb0 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 -- 172.21.15.12:0/2534379441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d4152cb0 msgr2=0x7f75d415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.622 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d4152cb0 0x7f75d415bd50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc02a210 comp rx=0 tx=0).stop 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 -- 172.21.15.12:0/2534379441 shutdown_connections 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d40c89f0 0x7f75d40c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 --2- 172.21.15.12:0/2534379441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d4152cb0 0x7f75d415bd50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 -- 172.21.15.12:0/2534379441 >> 172.21.15.12:0/2534379441 conn(0x7f75d4068270 msgr2=0x7f75d4068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 -- 172.21.15.12:0/2534379441 shutdown_connections 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.621+0000 7f75d9319640 1 -- 172.21.15.12:0/2534379441 wait complete. 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.622+0000 7f75d9319640 1 Processor -- start 2024-04-26T18:07:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.622+0000 7f75d9319640 1 -- start start 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d40c89f0 0x7f75d4157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 0x7f75d4150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40c4d20 con 0x7f75d40c7c20 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40c4ba0 con 0x7f75d40c89f0 2024-04-26T18:07:00.625 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d9319640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f75d40cdb70 con 0x7f75d4152cb0 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44240/0 (socket says 172.21.15.12:44240) 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 -- 172.21.15.12:0/1652734906 learned_addr learned my addr 172.21.15.12:0/1652734906 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d37fe640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 0x7f75d4150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d27fc640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d40c89f0 0x7f75d4157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 -- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 msgr2=0x7f75d4150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 0x7f75d4150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 -- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d40c89f0 msgr2=0x7f75d4157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d40c89f0 0x7f75d4157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d2ffd640 1 -- 172.21.15.12:0/1652734906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d414e230 con 0x7f75d40c7c20 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.623+0000 7f75d37fe640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 0x7f75d4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75d2ffd640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc041070 con 0x7f75d40c7c20 2024-04-26T18:07:00.626 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc03c870 con 0x7f75d40c7c20 2024-04-26T18:07:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d414e4d0 con 0x7f75d40c7c20 2024-04-26T18:07:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc037040 con 0x7f75d40c7c20 2024-04-26T18:07:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.624+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d414c1c0 con 0x7f75d40c7c20 2024-04-26T18:07:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.625+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d4076d20 con 0x7f75d40c7c20 2024-04-26T18:07:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.625+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f75cc044070 con 0x7f75d40c7c20 2024-04-26T18:07:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.626+0000 7f75cb7fe640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 0x7f75b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.626+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f75cc0ac930 con 0x7f75d40c7c20 2024-04-26T18:07:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.626+0000 7f75d27fc640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 0x7f75b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.628 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.626+0000 7f75d27fc640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 0x7f75b406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ccef0 tx=0x7f75bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.630 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.630+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f75cc07a3f0 con 0x7f75d40c7c20 2024-04-26T18:07:00.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.855+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75d4073480 con 0x7f75d40c7c20 2024-04-26T18:07:00.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.855+0000 7f75cb7fe640 1 -- 172.21.15.12:0/1652734906 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f75cc07e6f0 con 0x7f75d40c7c20 2024-04-26T18:07:00.856 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:07:00.856 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:07:00.856 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 msgr2=0x7f75b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 0x7f75b406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f75d40ccef0 tx=0x7f75bc009190 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 msgr2=0x7f75d414dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0097a0 tx=0x7f75cc0046c0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 shutdown_connections 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f75b406c8f0 0x7f75b406edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f75d4152cb0 0x7f75d4150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d40c89f0 0x7f75d4157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 --2- 172.21.15.12:0/1652734906 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f75d40c7c20 0x7f75d414dba0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 >> 172.21.15.12:0/1652734906 conn(0x7f75d4068270 msgr2=0x7f75d40cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 shutdown_connections 2024-04-26T18:07:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.857+0000 7f75d9319640 1 -- 172.21.15.12:0/1652734906 wait complete. 2024-04-26T18:07:00.868 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0' 2024-04-26T18:07:00.868 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0 2024-04-26T18:07:00.978 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.978+0000 7fbc33af1640 1 Processor -- start 2024-04-26T18:07:00.979 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.978+0000 7fbc33af1640 1 -- start start 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c155e20 0x7fbc2c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 0x7fbc2c0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2c156200 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2c0cd550 con 0x7fbc2c0c64b0 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc33af1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c15c330 con 0x7fbc2c155e20 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc3208e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc3208e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44244/0 (socket says 172.21.15.12:44244) 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc3208e640 1 -- 172.21.15.12:0/932211466 learned_addr learned my addr 172.21.15.12:0/932211466 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:00.980 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc3108c640 1 --2- 172.21.15.12:0/932211466 >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 0x7fbc2c0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.979+0000 7fbc3188d640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c155e20 0x7fbc2c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 -- 172.21.15.12:0/932211466 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c155e20 msgr2=0x7fbc2c15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c155e20 0x7fbc2c15bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 -- 172.21.15.12:0/932211466 >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 msgr2=0x7fbc2c0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 --2- 172.21.15.12:0/932211466 >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 0x7fbc2c0c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 -- 172.21.15.12:0/932211466 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c15c610 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3108c640 1 --2- 172.21.15.12:0/932211466 >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 0x7fbc2c0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:00.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.980+0000 7fbc3208e640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c06a090 tx=0x7fbc1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7397727fed2346 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.982 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc3088b640 1 -- 172.21.15.12:0/932211466 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c037070 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc3088b640 1 -- 172.21.15.12:0/932211466 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c032440 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc3088b640 1 -- 172.21.15.12:0/932211466 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c032810 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 -- 172.21.15.12:0/932211466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 msgr2=0x7fbc2c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c06a090 tx=0x7fbc1c02a270 comp rx=0 tx=0).stop 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 -- 172.21.15.12:0/932211466 shutdown_connections 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0cc1c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 --2- 172.21.15.12:0/932211466 >> v2:172.21.15.100:3300/0 conn(0x7fbc2c0c64b0 0x7fbc2c0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 --2- 172.21.15.12:0/932211466 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c155e20 0x7fbc2c15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 -- 172.21.15.12:0/932211466 >> 172.21.15.12:0/932211466 conn(0x7fbc2c072930 msgr2=0x7fbc2c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 -- 172.21.15.12:0/932211466 shutdown_connections 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.981+0000 7fbc33af1640 1 -- 172.21.15.12:0/932211466 wait complete. 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.982+0000 7fbc33af1640 1 Processor -- start 2024-04-26T18:07:00.983 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.982+0000 7fbc33af1640 1 -- start start 2024-04-26T18:07:00.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c0c64b0 0x7fbc2c1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc2c155e20 0x7fbc2c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.985 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0c72d0 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0c6ff0 con 0x7fbc2c155e20 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc33af1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c15c050 con 0x7fbc2c0c64b0 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44252/0 (socket says 172.21.15.12:44252) 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 -- 172.21.15.12:0/3408491050 learned_addr learned my addr 172.21.15.12:0/3408491050 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3208e640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc2c155e20 0x7fbc2c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3188d640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c0c64b0 0x7fbc2c1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 -- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c0c64b0 msgr2=0x7fbc2c1f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c0c64b0 0x7fbc2c1f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 -- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc2c155e20 msgr2=0x7fbc2c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc2c155e20 0x7fbc2c157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.983+0000 7fbc3108c640 1 -- 172.21.15.12:0/3408491050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c1488b0 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc3108c640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d800 tx=0x7fbc2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.986 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc2a7fc640 1 -- 172.21.15.12:0/3408491050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20004030 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc2a7fc640 1 -- 172.21.15.12:0/3408491050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200041d0 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c0d1260 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc2a7fc640 1 -- 172.21.15.12:0/3408491050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000b6c0 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.984+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c1f18c0 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.987 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.985+0000 7fbc2a7fc640 1 -- 172.21.15.12:0/3408491050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc2000b860 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.986+0000 7fbc2a7fc640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 0x7fbc1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.986+0000 7fbc2a7fc640 1 -- 172.21.15.12:0/3408491050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fbc2008c180 con 0x7fbc2c0c7d30 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.986+0000 7fbc3188d640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 0x7fbc1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.987+0000 7fbc3188d640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 0x7fbc1806edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc240039e0 tx=0x7fbc24009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.987+0000 7fbc3680a740 1 Processor -- start 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.987+0000 7fbc3680a740 1 -- start start 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c1df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1e4b80d80 con 0x55f1e4c5cae0 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f1e4b1cc20 con 0x55f1e4c1eb40 2024-04-26T18:07:00.990 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55f1e4b7cd40 con 0x55f1e4c1d5e0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3188d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c1df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44264/0 (socket says 172.21.15.12:44264) 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 -- 172.21.15.12:0/4250143660 learned_addr learned my addr 172.21.15.12:0/4250143660 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3188d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:39702/0 (socket says 172.21.15.12:39702) 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 -- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 msgr2=0x55f1e4c5c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 -- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 msgr2=0x55f1e4c1df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c1df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 -- 172.21.15.12:0/4250143660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e495ed80 con 0x55f1e4c5cae0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3188d640 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc3108c640 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbc2008a210 tx=0x7fbc20059700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7014b9ab01032ff server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc137fe640 1 -- 172.21.15.12:0/4250143660 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20062650 con 0x55f1e4c5cae0 2024-04-26T18:07:00.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc137fe640 1 -- 172.21.15.12:0/4250143660 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc20057b30 con 0x55f1e4c5cae0 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.988+0000 7fbc137fe640 1 -- 172.21.15.12:0/4250143660 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20056100 con 0x55f1e4c5cae0 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 -- 172.21.15.12:0/4250143660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 msgr2=0x55f1e4c1d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbc2008a210 tx=0x7fbc20059700 comp rx=0 tx=0).stop 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 -- 172.21.15.12:0/4250143660 shutdown_connections 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c1df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c1d9c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 --2- 172.21.15.12:0/4250143660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c5c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 -- 172.21.15.12:0/4250143660 >> 172.21.15.12:0/4250143660 conn(0x55f1e4be4740 msgr2=0x55f1e4c61580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 -- 172.21.15.12:0/4250143660 shutdown_connections 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.989+0000 7fbc3680a740 1 -- 172.21.15.12:0/4250143660 wait complete. 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.990+0000 7fbc3680a740 1 -- start start 2024-04-26T18:07:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.990+0000 7fbc3680a740 1 Processor -- start 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1d5e0 0x55f1e4c5a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55f1e4c1bc20 con 0x55f1e4c5cae0 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55f1e4b1a840 con 0x55f1e4c1d5e0 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55f1e4c1f170 con 0x55f1e4c1eb40 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3680a740 10 client.0 _ll_register_callbacks cb 0x55f1e4b1e5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:00.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44270/0 (socket says 172.21.15.12:44270) 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3208e640 1 -- 172.21.15.12:0/2792245219 learned_addr learned my addr 172.21.15.12:0/2792245219 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3188d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1d5e0 0x55f1e4c5a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:39716/0 (socket says 172.21.15.12:39716) 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 -- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1d5e0 msgr2=0x55f1e4c5a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1d5e0 0x55f1e4c5a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 -- 172.21.15.12:0/2792245219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 msgr2=0x55f1e4c6dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 -- 172.21.15.12:0/2792245219 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e49bf510 con 0x55f1e4c1eb40 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3208e640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc3108c640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc20059a20 tx=0x7fbc2005d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e8fb7a6408765c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:00.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3301/0 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.991+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc20062650 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc20057b30 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mon.2 v2:172.21.15.100:3301/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fbc20079070 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbc20083bd0 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 10 client.4799 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f1e4852670 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mon.2 v2:172.21.15.100:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc20057b30 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mon.2 v2:172.21.15.100:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fbc20074070 con 0x55f1e4c1eb40 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 10 client.4799 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 10 client.4799 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 20 client.4799 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:00.998 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c6e200 0x55f1e4c71290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 4 client.4799 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1e4b8e990 con 0x55f1e4c6e200 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3188d640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c6e200 0x55f1e4c71290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc3188d640 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c6e200 0x55f1e4c71290 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4982e35f3a6ba3a server_cookie=3a6bf11c1f9606f7 in_seq=0 out_seq=0 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.992+0000 7fbc10ff9640 10 client.4799 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc10ff9640 1 -- 172.21.15.12:0/2792245219 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f1e4b8e990 con 0x55f1e4c6e200 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc10ff9640 10 client.4799 handle_command_reply: tid=0 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 client.4799 shutdown 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 msgr2=0x55f1e4c44b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc20059a20 tx=0x7fbc2005d040 comp rx=0 tx=0).stop 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 shutdown_connections 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c6dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1eb40 0x55f1e4c44b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:00.999 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c6e200 0x55f1e4c71290 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 --2- 172.21.15.12:0/2792245219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1d5e0 0x55f1e4c5a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc10ff9640 0 client.4799 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 >> 172.21.15.12:0/2792245219 conn(0x55f1e4be4740 msgr2=0x55f1e4c1e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 shutdown_connections 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 1 -- 172.21.15.12:0/2792245219 wait complete. 2024-04-26T18:07:01.000 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:00.993+0000 7fbc3680a740 20 client.4799 trim_cache size 0 max 16384 2024-04-26T18:07:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 Processor -- start 2024-04-26T18:07:01.011 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 -- start start 2024-04-26T18:07:01.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c81df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c44860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.012 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c2007a0 con 0x55f1e4c5cae0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c1ff680 con 0x55f1e4c1eb40 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.011+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c1fdbf0 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44284/0 (socket says 172.21.15.12:44284) 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 -- 172.21.15.12:0/401789866 learned_addr learned my addr 172.21.15.12:0/401789866 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3188d640 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c81df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3108c640 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c44860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 -- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 msgr2=0x55f1e4c81df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c81df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 -- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 msgr2=0x55f1e4c44860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c44860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 -- 172.21.15.12:0/401789866 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1e4c1ada0 con 0x55f1e4c5cae0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc3208e640 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009960 tx=0x7fbc1c034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ae670d3129295c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc12ffd640 1 -- 172.21.15.12:0/401789866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c037040 con 0x55f1e4c5cae0 2024-04-26T18:07:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc12ffd640 1 -- 172.21.15.12:0/401789866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0327d0 con 0x55f1e4c5cae0 2024-04-26T18:07:01.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.012+0000 7fbc12ffd640 1 -- 172.21.15.12:0/401789866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c032ba0 con 0x55f1e4c5cae0 2024-04-26T18:07:01.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- 172.21.15.12:0/401789866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 msgr2=0x55f1e4c44da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:01.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009960 tx=0x7fbc1c034040 comp rx=0 tx=0).stop 2024-04-26T18:07:01.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- 172.21.15.12:0/401789866 shutdown_connections 2024-04-26T18:07:01.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c44da0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c1eb40 0x55f1e4c44860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 --2- 172.21.15.12:0/401789866 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c81df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- 172.21.15.12:0/401789866 >> 172.21.15.12:0/401789866 conn(0x55f1e4be4740 msgr2=0x55f1e4c134d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- 172.21.15.12:0/401789866 shutdown_connections 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- 172.21.15.12:0/401789866 wait complete. 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 -- start start 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.013+0000 7fbc3680a740 1 Processor -- start 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c80d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c5acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c1fe210 con 0x55f1e4c1eb40 2024-04-26T18:07:01.020 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c1fefb0 con 0x55f1e4c5cae0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c1fe8e0 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3680a740 10 client.0 _ll_register_callbacks cb 0x7fbc20072050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3188d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c80d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3108c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44300/0 (socket says 172.21.15.12:44300) 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3208e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c5acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.014+0000 7fbc3108c640 1 -- 172.21.15.12:0/1379583401 learned_addr learned my addr 172.21.15.12:0/1379583401 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 -- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c5cae0 msgr2=0x55f1e4c5acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c5acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 -- 172.21.15.12:0/1379583401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 msgr2=0x55f1e4cd1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 -- 172.21.15.12:0/1379583401 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f1e4b1f070 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.021 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3108c640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3188d640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c80d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55f1e4c6e720 tx=0x7fbc24004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=230b3584dda0ed0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 10 client.0 ms_handle_connect on v2:172.21.15.100:3301/0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc240257a0 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mon.2 v2:172.21.15.100:3301/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fbc24012040 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc1c0327d0 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fbc2403b050 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 10 client.4805 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55f1e4c18280 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mon.2 v2:172.21.15.100:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0327d0 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mon.2 v2:172.21.15.100:3301/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fbc2403e020 con 0x55f1e4c1d5e0 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 10 client.4805 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 10 client.4805 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:01.022 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 20 client.4805 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c5b1f0 0x55f1e4cdab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.015+0000 7fbc3680a740 4 client.4805 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}] 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.016+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}) -- 0x55f1e4b88800 con 0x55f1e4c5b1f0 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.016+0000 7fbc3108c640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c5b1f0 0x55f1e4cdab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.016+0000 7fbc3108c640 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c5b1f0 0x55f1e4cdab00 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b1edf97c358de6a server_cookie=a3ba7e09c26a0061 in_seq=0 out_seq=0 2024-04-26T18:07:01.023 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:01.016+0000 7fbc10ff9640 10 client.4805 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:11.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc10ff9640 1 -- 172.21.15.12:0/1379583401 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55f1e4b88800 con 0x55f1e4c5b1f0 2024-04-26T18:07:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc10ff9640 10 client.4805 handle_command_reply: tid=0 2024-04-26T18:07:11.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 client.4805 shutdown 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 msgr2=0x55f1e4c80d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c80d30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x55f1e4c6e720 tx=0x7fbc24004ab0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 shutdown_connections 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55f1e4c5b1f0 0x55f1e4cdab00 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc10ff9640 0 client.4805 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:11.701 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55f1e4c5cae0 0x55f1e4c5acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.699+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55f1e4c1eb40 0x55f1e4cd1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.700+0000 7fbc3680a740 1 --2- 172.21.15.12:0/1379583401 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55f1e4c1d5e0 0x55f1e4c80d30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.700+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 >> 172.21.15.12:0/1379583401 conn(0x55f1e4be4740 msgr2=0x55f1e4c132c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.700+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 shutdown_connections 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.700+0000 7fbc3680a740 1 -- 172.21.15.12:0/1379583401 wait complete. 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.700+0000 7fbc3680a740 20 client.4805 trim_cache size 0 max 16384 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:07:11.702 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 26, 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "cc15da21": { 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 26, 2024-04-26T18:07:11.703 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:07:11.704 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 81.2, 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:07:11.705 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:11.706 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 msgr2=0x7fbc1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 0x7fbc1806edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc240039e0 tx=0x7fbc24009830 comp rx=0 tx=0).stop 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 msgr2=0x7fbc2c0d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000d800 tx=0x7fbc2000dcc0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 shutdown_connections 2024-04-26T18:07:11.708 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc2c155e20 0x7fbc2c157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc2c0c7d30 0x7fbc2c0d0bb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbc1806c8f0 0x7fbc1806edb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 --2- 172.21.15.12:0/3408491050 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc2c0c64b0 0x7fbc2c1f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 >> 172.21.15.12:0/3408491050 conn(0x7fbc2c072930 msgr2=0x7fbc2c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 shutdown_connections 2024-04-26T18:07:11.709 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:11.701+0000 7fbc33af1640 1 -- 172.21.15.12:0/3408491050 wait complete. 2024-04-26T18:07:11.714 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cc15da21', quiesce took 11.2 seconds. Will release after: 21.2 2024-04-26T18:07:15.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:15.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:32.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:33.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.029+0000 7fdac092b640 1 Processor -- start 2024-04-26T18:07:33.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.029+0000 7fdac092b640 1 -- start start 2024-04-26T18:07:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc153de0 0x7fdabc070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdabc0c9cf0 0x7fdabc0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 0x7fdabc159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fdabc070990 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fdabc070c70 con 0x7fdabc0cf780 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdac092b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc0ca670 con 0x7fdabc153de0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdabc0c9cf0 0x7fdabc0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdabc0c9cf0 0x7fdabc0cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41492/0 (socket says 172.21.15.12:41492) 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 -- 172.21.15.12:0/1678051173 learned_addr learned my addr 172.21.15.12:0/1678051173 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdaba59c640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc153de0 0x7fdabc070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdabad9d640 1 --2- 172.21.15.12:0/1678051173 >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 0x7fdabc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 -- 172.21.15.12:0/1678051173 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc153de0 msgr2=0x7fdabc070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc153de0 0x7fdabc070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 -- 172.21.15.12:0/1678051173 >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 msgr2=0x7fdabc159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 --2- 172.21.15.12:0/1678051173 >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 0x7fdabc159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdab3fff640 1 -- 172.21.15.12:0/1678051173 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc0ca950 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.030+0000 7fdabad9d640 1 --2- 172.21.15.12:0/1678051173 >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 0x7fdabc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.031+0000 7fdab3fff640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc0cf240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdabc068e60 tx=0x7fdaa402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88373ecb251c5ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.031+0000 7fdab9d9b640 1 -- 172.21.15.12:0/1678051173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4037070 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.031+0000 7fdab9d9b640 1 -- 172.21.15.12:0/1678051173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaa4032440 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.031+0000 7fdab9d9b640 1 -- 172.21.15.12:0/1678051173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4032810 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 -- 172.21.15.12:0/1678051173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 msgr2=0x7fdabc0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc0cf240 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdabc068e60 tx=0x7fdaa402a270 comp rx=0 tx=0).stop 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 -- 172.21.15.12:0/1678051173 shutdown_connections 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 --2- 172.21.15.12:0/1678051173 >> v2:172.21.15.100:3300/0 conn(0x7fdabc0cf780 0x7fdabc159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc0cf240 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 --2- 172.21.15.12:0/1678051173 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc153de0 0x7fdabc070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 -- 172.21.15.12:0/1678051173 >> 172.21.15.12:0/1678051173 conn(0x7fdabc076730 msgr2=0x7fdabc068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 -- 172.21.15.12:0/1678051173 shutdown_connections 2024-04-26T18:07:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.032+0000 7fdac092b640 1 -- 172.21.15.12:0/1678051173 wait complete. 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.033+0000 7fdac092b640 1 Processor -- start 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.033+0000 7fdac092b640 1 -- start start 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc0cf780 0x7fdabc0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdabc153de0 0x7fdabc148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc0ca110 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc0caf10 con 0x7fdabc153de0 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdac092b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc0c63c0 con 0x7fdabc0cf780 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdaba59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdaba59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41502/0 (socket says 172.21.15.12:41502) 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdaba59c640 1 -- 172.21.15.12:0/3556112516 learned_addr learned my addr 172.21.15.12:0/3556112516 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdab3fff640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc0cf780 0x7fdabc0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.034+0000 7fdabad9d640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdabc153de0 0x7fdabc148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 -- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc0cf780 msgr2=0x7fdabc0c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc0cf780 0x7fdabc0c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 -- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdabc153de0 msgr2=0x7fdabc148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdabc153de0 0x7fdabc148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 -- 172.21.15.12:0/3556112516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc150390 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdaba59c640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00e870 tx=0x7fdaac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac017070 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac00c940 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00cd30 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc14fdd0 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.035+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc150de0 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.036+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc076d20 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.037+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdaac01a070 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.037+0000 7fdab2ffd640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 0x7fda9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.037+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fdaac08c220 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.037+0000 7fdab3fff640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 0x7fda9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.038+0000 7fdab3fff640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 0x7fda9c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4034000 tx=0x7fdaa402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.046+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdaac05a180 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.364+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdabc14f650 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.364+0000 7fdab2ffd640 1 -- 172.21.15.12:0/3556112516 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fdaac059a80 con 0x7fdabc0c9cf0 2024-04-26T18:07:33.364 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:07:33.364 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:07:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:07:33.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 msgr2=0x7fda9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 0x7fda9c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4034000 tx=0x7fdaa402e000 comp rx=0 tx=0).stop 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 msgr2=0x7fdabc1f2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00e870 tx=0x7fdaac00ed30 comp rx=0 tx=0).stop 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 shutdown_connections 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdabc153de0 0x7fdabc148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fda9c06c8f0 0x7fda9c06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fdabc0cf780 0x7fdabc0c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 --2- 172.21.15.12:0/3556112516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdabc0c9cf0 0x7fdabc1f2b80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 >> 172.21.15.12:0/3556112516 conn(0x7fdabc076730 msgr2=0x7fdabc0cd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 shutdown_connections 2024-04-26T18:07:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.366+0000 7fdac092b640 1 -- 172.21.15.12:0/3556112516 wait complete. 2024-04-26T18:07:33.377 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id cc15da21 --release --await' 2024-04-26T18:07:33.377 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id cc15da21 --release --await 2024-04-26T18:07:33.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.486+0000 7f4c80ba4640 1 Processor -- start 2024-04-26T18:07:33.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.486+0000 7f4c80ba4640 1 -- start start 2024-04-26T18:07:33.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c80ba4640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4c7c155d70 0x7f4c7c0d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c80ba4640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4c7c156150 0x7f4c7c0d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c80ba4640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0cc2a0 con 0x7f4c7c0c6860 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c80ba4640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c0cc070 con 0x7f4c7c155d70 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c80ba4640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7c15c850 con 0x7f4c7c156150 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7ad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4c7c0c6860 0x7f4c7c15f1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59438/0 (socket says 172.21.15.12:59438) 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7ad9d640 1 -- 172.21.15.12:0/4079624291 learned_addr learned my addr 172.21.15.12:0/4079624291 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4079624291 >> v2:172.21.15.12:3300/0 conn(0x7f4c7c155d70 0x7f4c7c0d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/4079624291 >> v2:172.21.15.100:3300/0 conn(0x7f4c7c156150 0x7f4c7c0d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7959a640 1 -- 172.21.15.12:0/4079624291 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215401484 0 0) 0x7f4c7c0cc2a0 con 0x7f4c7c0c6860 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7959a640 1 -- 172.21.15.12:0/4079624291 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c68003520 con 0x7f4c7c0c6860 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7a59c640 1 -- 172.21.15.12:0/4079624291 >> v2:172.21.15.100:3300/0 conn(0x7f4c7c156150 msgr2=0x7f4c7c0d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4079624291 >> v2:172.21.15.100:3300/0 conn(0x7f4c7c156150 0x7f4c7c0d1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7a59c640 1 -- 172.21.15.12:0/4079624291 >> v1:172.21.15.12:6789/0 conn(0x7f4c7c0c6860 legacy=0x7f4c7c15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.487+0000 7f4c7a59c640 1 -- 172.21.15.12:0/4079624291 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c15bf20 con 0x7f4c7c155d70 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.488+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4079624291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c0d1320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c074aa0 tx=0x7f4c7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e477e73f682f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.488+0000 7f4c7959a640 1 -- 172.21.15.12:0/4079624291 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74037070 con 0x7f4c7c155d70 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.488+0000 7f4c7959a640 1 -- 172.21.15.12:0/4079624291 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74032440 con 0x7f4c7c155d70 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.488+0000 7f4c7959a640 1 -- 172.21.15.12:0/4079624291 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74032810 con 0x7f4c7c155d70 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 -- 172.21.15.12:0/4079624291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 msgr2=0x7f4c7c0d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/4079624291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c0d1320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c074aa0 tx=0x7f4c7402a230 comp rx=0 tx=0).stop 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 -- 172.21.15.12:0/4079624291 shutdown_connections 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/4079624291 >> v2:172.21.15.100:3300/0 conn(0x7f4c7c156150 0x7f4c7c0d1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/4079624291 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c0d1320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 -- 172.21.15.12:0/4079624291 >> 172.21.15.12:0/4079624291 conn(0x7f4c7c076100 msgr2=0x7f4c7c073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 -- 172.21.15.12:0/4079624291 shutdown_connections 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.489+0000 7f4c80ba4640 1 -- 172.21.15.12:0/4079624291 wait complete. 2024-04-26T18:07:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.490+0000 7f4c80ba4640 1 Processor -- start 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.490+0000 7f4c80ba4640 1 -- start start 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c0c6860 0x7f4c7c0b66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 0x7f4c7c148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c15bbf0 con 0x7f4c7c155d70 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c15c4e0 con 0x7f4c7c0c6860 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c80ba4640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c0cda10 con 0x7f4c7c156150 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41524/0 (socket says 172.21.15.12:41524) 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1602138422 learned_addr learned my addr 172.21.15.12:0/1602138422 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c0c6860 0x7f4c7c0b66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c7ad9d640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 0x7f4c7c148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 msgr2=0x7f4c7c148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 0x7f4c7c148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c0c6860 msgr2=0x7f4c7c0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c0c6860 0x7f4c7c0b66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1602138422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c0d0510 con 0x7f4c7c155d70 2024-04-26T18:07:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c7ad9d640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 0x7f4c7c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.491+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400d5f0 tx=0x7f4c6400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.492+0000 7f4c72ffd640 1 -- 172.21.15.12:0/1602138422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640125f0 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.492+0000 7f4c72ffd640 1 -- 172.21.15.12:0/1602138422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c64019070 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.492+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c0cf790 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.492+0000 7f4c72ffd640 1 -- 172.21.15.12:0/1602138422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640129d0 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.492+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1518a0 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.493+0000 7f4c72ffd640 1 -- 172.21.15.12:0/1602138422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c64012b70 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.494+0000 7f4c72ffd640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 0x7f4c5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.494+0000 7f4c72ffd640 1 -- 172.21.15.12:0/1602138422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4c6408c3c0 con 0x7f4c7c155d70 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.494+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 0x7f4c5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.494+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 0x7f4c5c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c74034000 tx=0x7f4c7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.495+0000 7f4c83997740 1 Processor -- start 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.495+0000 7f4c83997740 1 -- start start 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.495+0000 7f4c83997740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.495+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b8f9b0 0x55b0f6b50890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c83997740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0f6ab5040 con 0x55b0f6b504b0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b0f6a50b60 con 0x55b0f6b51a10 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55b0f6ab1000 con 0x55b0f6b8f9b0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41538/0 (socket says 172.21.15.12:41538) 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3446085341 learned_addr learned my addr 172.21.15.12:0/3446085341 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b8f9b0 0x55b0f6b50890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7ad9d640 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b8f9b0 msgr2=0x55b0f6b50890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b8f9b0 0x55b0f6b50890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b51a10 msgr2=0x55b0f6b50dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3446085341 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f6a459c0 con 0x55b0f6b504b0 2024-04-26T18:07:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000c00 tx=0x7f4c7402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8670b320887a37 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c5bfff640 1 -- 172.21.15.12:0/3446085341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7404e070 con 0x55b0f6b504b0 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c5bfff640 1 -- 172.21.15.12:0/3446085341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74032d40 con 0x55b0f6b504b0 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.496+0000 7f4c5bfff640 1 -- 172.21.15.12:0/3446085341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74037040 con 0x55b0f6b504b0 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 -- 172.21.15.12:0/3446085341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 msgr2=0x55b0f6b8f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4c74000c00 tx=0x7f4c7402c000 comp rx=0 tx=0).stop 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 -- 172.21.15.12:0/3446085341 shutdown_connections 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b8f9b0 0x55b0f6b50890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 --2- 172.21.15.12:0/3446085341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6b8f470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 -- 172.21.15.12:0/3446085341 >> 172.21.15.12:0/3446085341 conn(0x55b0f6b17930 msgr2=0x55b0f6b94450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 -- 172.21.15.12:0/3446085341 shutdown_connections 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.497+0000 7f4c83997740 1 -- 172.21.15.12:0/3446085341 wait complete. 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.498+0000 7f4c83997740 1 -- start start 2024-04-26T18:07:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.498+0000 7f4c83997740 1 Processor -- start 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.498+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6b7a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6ba1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55b0f6b4eaf0 con 0x55b0f6b51a10 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55b0f6a4e4f0 con 0x55b0f6b8f9b0 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55b0f6b52040 con 0x55b0f6b504b0 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 10 client.0 _ll_register_callbacks cb 0x55b0f6aabc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41540/0 (socket says 172.21.15.12:41540) 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 -- 172.21.15.12:0/4051604371 learned_addr learned my addr 172.21.15.12:0/4051604371 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6b7a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c7ad9d640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6ba1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 -- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 msgr2=0x55b0f6b7a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6b7a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 -- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 msgr2=0x55b0f6ba1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6ba1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 -- 172.21.15.12:0/4051604371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f67c6920 con 0x55b0f6b51a10 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6b7a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4c6408a4b0 tx=0x7f4c64059df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01f4a174bf8e7ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6408c0b0 con 0x55b0f6b51a10 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4c64056320 con 0x55b0f6b51a10 2024-04-26T18:07:33.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c74032d40 con 0x55b0f6b51a10 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c64062400 con 0x55b0f6b51a10 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.499+0000 7f4c83997740 10 client.5151 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b0f6892d30 con 0x55b0f6b51a10 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74032d40 con 0x55b0f6b51a10 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c64013070 con 0x55b0f6b51a10 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 10 client.5151 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 10 client.5151 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 20 client.5151 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6ba3d30 0x55b0f6ba4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 4 client.5151 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b0f6a88a00 con 0x55b0f6ba3d30 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6ba3d30 0x55b0f6ba4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c597fa640 10 client.5151 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.500+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6ba3d30 0x55b0f6ba4130 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f76756676522786 server_cookie=fd233bad33bcde72 in_seq=0 out_seq=0 2024-04-26T18:07:33.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c597fa640 1 -- 172.21.15.12:0/4051604371 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b0f6a88a00 con 0x55b0f6ba3d30 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c597fa640 10 client.5151 handle_command_reply: tid=0 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 client.5151 shutdown 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 msgr2=0x55b0f6b50c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4c6408a4b0 tx=0x7f4c64059df0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 shutdown_connections 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6ba3d30 0x55b0f6ba4130 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6ba1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b50c90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 --2- 172.21.15.12:0/4051604371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6b7a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c597fa640 0 client.5151 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 >> 172.21.15.12:0/4051604371 conn(0x55b0f6b17930 msgr2=0x55b0f6b79ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 shutdown_connections 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 1 -- 172.21.15.12:0/4051604371 wait complete. 2024-04-26T18:07:33.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.501+0000 7f4c83997740 20 client.5151 trim_cache size 0 max 16384 2024-04-26T18:07:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 Processor -- start 2024-04-26T18:07:33.520 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 -- start start 2024-04-26T18:07:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b51a10 0x55b0f6b87330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6b87870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c200330 con 0x55b0f6b504b0 2024-04-26T18:07:33.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1ff210 con 0x55b0f6b8f9b0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c1fd800 con 0x55b0f6b51a10 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c7a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c7a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41542/0 (socket says 172.21.15.12:41542) 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3961251343 learned_addr learned my addr 172.21.15.12:0/3961251343 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c7ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6b87870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.521+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b51a10 0x55b0f6b87330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b51a10 msgr2=0x55b0f6b87330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b51a10 0x55b0f6b87330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 msgr2=0x55b0f6b87870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6b87870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 -- 172.21.15.12:0/3961251343 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0f6b4dc70 con 0x55b0f6b504b0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c7402a820 tx=0x7f4c7403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1ea926ef6c9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c5b7fe640 1 -- 172.21.15.12:0/3961251343 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7404e040 con 0x55b0f6b504b0 2024-04-26T18:07:33.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c5b7fe640 1 -- 172.21.15.12:0/3961251343 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74050040 con 0x55b0f6b504b0 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.522+0000 7f4c5b7fe640 1 -- 172.21.15.12:0/3961251343 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74037040 con 0x55b0f6b504b0 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- 172.21.15.12:0/3961251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 msgr2=0x55b0f6bb4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c7402a820 tx=0x7f4c7403b000 comp rx=0 tx=0).stop 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- 172.21.15.12:0/3961251343 shutdown_connections 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6b87870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b51a10 0x55b0f6b87330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 --2- 172.21.15.12:0/3961251343 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b504b0 0x55b0f6bb4b70 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- 172.21.15.12:0/3961251343 >> 172.21.15.12:0/3961251343 conn(0x55b0f6b17930 msgr2=0x55b0f6b7a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- 172.21.15.12:0/3961251343 shutdown_connections 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- 172.21.15.12:0/3961251343 wait complete. 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 -- start start 2024-04-26T18:07:33.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.523+0000 7f4c83997740 1 Processor -- start 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6c0dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6c04440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1fdda0 con 0x55b0f6b51a10 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1feb40 con 0x55b0f6b8f9b0 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7c1fe470 con 0x55b0f6b504b0 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c83997740 10 client.0 _ll_register_callbacks cb 0x7f4c64059610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.528 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c79d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41550/0 (socket says 172.21.15.12:41550) 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1532973927 learned_addr learned my addr 172.21.15.12:0/1532973927 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6c0dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.524+0000 7f4c7ad9d640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6c04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 msgr2=0x55b0f6c0dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6c0dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 msgr2=0x55b0f6c04440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6c04440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 -- 172.21.15.12:0/1532973927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0f6b9d380 con 0x55b0f6b51a10 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c79d9b640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c6408a500 tx=0x7f4c64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb17f4e23740329c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64012e60 con 0x55b0f6b51a10 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4c64079170 con 0x55b0f6b51a10 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c74050040 con 0x55b0f6b51a10 2024-04-26T18:07:33.529 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f4c6407e050 con 0x55b0f6b51a10 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 10 client.5157 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55b0f6ba2fc0 con 0x55b0f6b51a10 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c74050040 con 0x55b0f6b51a10 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f4c64081080 con 0x55b0f6b51a10 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 10 client.5157 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 10 client.5157 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 20 client.5157 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6c04980 0x55b0f6ba0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 4 client.5157 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cc15da21", "release": true, "await": true}] 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.525+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cc15da21", "release": true, "await": true}) -- 0x55b0f6ac2c50 con 0x55b0f6c04980 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6c04980 0x55b0f6ba0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c597fa640 10 client.5157 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c7a59c640 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6c04980 0x55b0f6ba0740 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35edd4d04aaa45e server_cookie=b3489b61fa83dc1 in_seq=0 out_seq=0 2024-04-26T18:07:33.530 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c597fa640 1 -- 172.21.15.12:0/1532973927 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55b0f6ac2c50 con 0x55b0f6c04980 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c597fa640 10 client.5157 handle_command_reply: tid=0 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 client.5157 shutdown 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 msgr2=0x55b0f6b777a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c6408a500 tx=0x7f4c64000bc0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 shutdown_connections 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55b0f6c04980 0x55b0f6ba0740 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55b0f6b8f9b0 0x55b0f6c04440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.531 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55b0f6b51a10 0x55b0f6b777a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 --2- 172.21.15.12:0/1532973927 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55b0f6b504b0 0x55b0f6c0dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c597fa640 0 client.5157 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 >> 172.21.15.12:0/1532973927 conn(0x55b0f6b17930 msgr2=0x55b0f6b87330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 shutdown_connections 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.526+0000 7f4c83997740 1 -- 172.21.15.12:0/1532973927 wait complete. 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c83997740 20 client.5157 trim_cache size 0 max 16384 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 28, 2024-04-26T18:07:33.532 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "cc15da21": { 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 28, 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 81.2, 2024-04-26T18:07:33.533 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:33.534 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:07:33.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 msgr2=0x7f4c5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 0x7f4c5c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4c74034000 tx=0x7f4c7402e000 comp rx=0 tx=0).stop 2024-04-26T18:07:33.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 msgr2=0x7f4c7c1f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.535 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4c6400d5f0 tx=0x7f4c6400dab0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 shutdown_connections 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4c5c06c8f0 0x7f4c5c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4c7c156150 0x7f4c7c148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4c7c155d70 0x7f4c7c1f1440 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 --2- 172.21.15.12:0/1602138422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c7c0c6860 0x7f4c7c0b66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 >> 172.21.15.12:0/1602138422 conn(0x7f4c7c076100 msgr2=0x7f4c7c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 shutdown_connections 2024-04-26T18:07:33.536 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.527+0000 7f4c80ba4640 1 -- 172.21.15.12:0/1602138422 wait complete. 2024-04-26T18:07:33.537 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cc15da21', seconds elapsed: 33.0 2024-04-26T18:07:33.537 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.2 2024-04-26T18:07:33.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:33.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.638+0000 7f8b8bc8c640 1 Processor -- start 2024-04-26T18:07:33.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.638+0000 7f8b8bc8c640 1 -- start start 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8bc8c640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8b84155c90 0x7f8b840735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8bc8c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b8415d020 0x7f8b8415d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8bc8c640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8415ca20 con 0x7f8b8415c5b0 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8bc8c640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f8b84156070 con 0x7f8b8415d020 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8bc8c640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f8b840c6330 con 0x7f8b84155c90 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b8a229640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b8415d020 0x7f8b8415d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b89227640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8b8415c5b0 0x7f8b840d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59444/0 (socket says 172.21.15.12:59444) 2024-04-26T18:07:33.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b89227640 1 -- 172.21.15.12:0/3463206358 learned_addr learned my addr 172.21.15.12:0/3463206358 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.639+0000 7f8b89a28640 1 --2- 172.21.15.12:0/3463206358 >> v2:172.21.15.100:3300/0 conn(0x7f8b84155c90 0x7f8b840735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b8a229640 1 -- 172.21.15.12:0/3463206358 >> v2:172.21.15.100:3300/0 conn(0x7f8b84155c90 msgr2=0x7f8b840735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b8a229640 1 --2- 172.21.15.12:0/3463206358 >> v2:172.21.15.100:3300/0 conn(0x7f8b84155c90 0x7f8b840735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b8a229640 1 -- 172.21.15.12:0/3463206358 >> v1:172.21.15.12:6789/0 conn(0x7f8b8415c5b0 legacy=0x7f8b840d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b8a229640 1 -- 172.21.15.12:0/3463206358 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b840c6610 con 0x7f8b8415d020 2024-04-26T18:07:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b88a26640 1 -- 172.21.15.12:0/3463206358 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3556815011 0 0) 0x7f8b8415ca20 con 0x7f8b8415c5b0 2024-04-26T18:07:33.641 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.640+0000 7f8b8a229640 1 --2- 172.21.15.12:0/3463206358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b8415d020 0x7f8b8415d490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b840732e0 tx=0x7f8b7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaaf01f8e4ce7fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b88a26640 1 -- 172.21.15.12:0/3463206358 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74037070 con 0x7f8b8415d020 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b88a26640 1 -- 172.21.15.12:0/3463206358 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b74032440 con 0x7f8b8415d020 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b88a26640 1 -- 172.21.15.12:0/3463206358 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b74032810 con 0x7f8b8415d020 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/3463206358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b8415d020 msgr2=0x7f8b8415d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/3463206358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b8415d020 0x7f8b8415d490 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8b840732e0 tx=0x7f8b7402a230 comp rx=0 tx=0).stop 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/3463206358 shutdown_connections 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/3463206358 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b8415d020 0x7f8b8415d490 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/3463206358 >> v2:172.21.15.100:3300/0 conn(0x7f8b84155c90 0x7f8b840735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/3463206358 >> 172.21.15.12:0/3463206358 conn(0x7f8b84074030 msgr2=0x7f8b84074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.642 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/3463206358 shutdown_connections 2024-04-26T18:07:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.641+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/3463206358 wait complete. 2024-04-26T18:07:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.642+0000 7f8b8bc8c640 1 Processor -- start 2024-04-26T18:07:33.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.642+0000 7f8b8bc8c640 1 -- start start 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b8415c5b0 0x7f8b841501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b8415d020 0x7f8b840cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f8b840c6eb0 con 0x7f8b84155c90 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f8b840c6bd0 con 0x7f8b8415c5b0 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8bc8c640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f8b840c7190 con 0x7f8b8415d020 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41570/0 (socket says 172.21.15.12:41570) 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 -- 172.21.15.12:0/4122384810 learned_addr learned my addr 172.21.15.12:0/4122384810 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89227640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b8415c5b0 0x7f8b841501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b8a229640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b8415d020 0x7f8b840cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 -- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b8415d020 msgr2=0x7f8b840cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b8415d020 0x7f8b840cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 -- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b8415c5b0 msgr2=0x7f8b841501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b8415c5b0 0x7f8b841501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.643+0000 7f8b89a28640 1 -- 172.21.15.12:0/4122384810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b840ce230 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b89a28640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009db0 tx=0x7f8b7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c018020 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c014480 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b841f54d0 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c014850 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.644+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b841f5a90 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.645+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b84076d20 con 0x7f8b84155c90 2024-04-26T18:07:33.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.645+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b7c005d10 con 0x7f8b84155c90 2024-04-26T18:07:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.646+0000 7f8b827fc640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 0x7f8b7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.646+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f8b7c08c950 con 0x7f8b84155c90 2024-04-26T18:07:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.646+0000 7f8b89227640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 0x7f8b7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:33.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.646+0000 7f8b89227640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 0x7f8b7006ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b8415eab0 tx=0x7f8b78007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.650+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b7c022070 con 0x7f8b84155c90 2024-04-26T18:07:33.892 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.893+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b840cc300 con 0x7f8b84155c90 2024-04-26T18:07:33.893 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.893+0000 7f8b827fc640 1 -- 172.21.15.12:0/4122384810 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f8b7c010040 con 0x7f8b84155c90 2024-04-26T18:07:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:07:33.893 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:07:33.894 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 msgr2=0x7f8b7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 0x7f8b7006ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8b8415eab0 tx=0x7f8b78007d50 comp rx=0 tx=0).stop 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 msgr2=0x7f8b841f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c009db0 tx=0x7f8b7c00c490 comp rx=0 tx=0).stop 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 shutdown_connections 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f8b7006c920 0x7f8b7006ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8b8415d020 0x7f8b840cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8b8415c5b0 0x7f8b841501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.895 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 --2- 172.21.15.12:0/4122384810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b84155c90 0x7f8b841f4e20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:33.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 >> 172.21.15.12:0/4122384810 conn(0x7f8b84074030 msgr2=0x7f8b840cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:33.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 shutdown_connections 2024-04-26T18:07:33.896 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:33.896+0000 7f8b8bc8c640 1 -- 172.21.15.12:0/4122384810 wait complete. 2024-04-26T18:07:33.907 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0' 2024-04-26T18:07:33.907 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 60 --expiration 81.2 --await-for 42.0 2024-04-26T18:07:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.025+0000 7effd31af640 1 Processor -- start 2024-04-26T18:07:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.025+0000 7effd31af640 1 -- start start 2024-04-26T18:07:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd31af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc155f60 0x7effcc0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd31af640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0cd520 0x7effcc15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd31af640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effcc15c450 con 0x7effcc0c63a0 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd31af640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7effcc15c730 con 0x7effcc0cd520 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd31af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7effcc15ca10 con 0x7effcc155f60 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effcbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0cd520 0x7effcc15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effcbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0cd520 0x7effcc15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41580/0 (socket says 172.21.15.12:41580) 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc155f60 0x7effcc0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effcbfff640 1 -- 172.21.15.12:0/3648347563 learned_addr learned my addr 172.21.15.12:0/3648347563 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.026+0000 7effd174c640 1 --1- 172.21.15.12:0/3648347563 >> v1:172.21.15.100:6789/0 conn(0x7effcc0c63a0 0x7effcc0cc140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:48572/0 (socket says 172.21.15.12:48572) 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcbfff640 1 -- 172.21.15.12:0/3648347563 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc155f60 msgr2=0x7effcc0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcbfff640 1 --2- 172.21.15.12:0/3648347563 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc155f60 0x7effcc0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcbfff640 1 -- 172.21.15.12:0/3648347563 >> v1:172.21.15.100:6789/0 conn(0x7effcc0c63a0 legacy=0x7effcc0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcbfff640 1 -- 172.21.15.12:0/3648347563 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc0c6ed0 con 0x7effcc0cd520 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcbfff640 1 --2- 172.21.15.12:0/3648347563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0cd520 0x7effcc15bac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7effb4009870 tx=0x7effb402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b5423695475a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcb7fe640 1 -- 172.21.15.12:0/3648347563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4037070 con 0x7effcc0cd520 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcb7fe640 1 -- 172.21.15.12:0/3648347563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb402ae50 con 0x7effcc0cd520 2024-04-26T18:07:34.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.027+0000 7effcb7fe640 1 -- 172.21.15.12:0/3648347563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4032860 con 0x7effcc0cd520 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 -- 172.21.15.12:0/3648347563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0cd520 msgr2=0x7effcc15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 --2- 172.21.15.12:0/3648347563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0cd520 0x7effcc15bac0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7effb4009870 tx=0x7effb402a300 comp rx=0 tx=0).stop 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 -- 172.21.15.12:0/3648347563 shutdown_connections 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 --2- 172.21.15.12:0/3648347563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0cd520 0x7effcc15bac0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 --2- 172.21.15.12:0/3648347563 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc155f60 0x7effcc0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 -- 172.21.15.12:0/3648347563 >> 172.21.15.12:0/3648347563 conn(0x7effcc072930 msgr2=0x7effcc072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 -- 172.21.15.12:0/3648347563 shutdown_connections 2024-04-26T18:07:34.029 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.028+0000 7effd31af640 1 -- 172.21.15.12:0/3648347563 wait complete. 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.029+0000 7effd31af640 1 Processor -- start 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.029+0000 7effd31af640 1 -- start start 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effcc0cd520 0x7effcc0cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7effcc0c7ef0 con 0x7effcc155f60 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effcc0c7490 con 0x7effcc0cd520 2024-04-26T18:07:34.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd31af640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7effcc0c6ab0 con 0x7effcc0c63a0 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd174c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effcbfff640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effcc0cd520 0x7effcc0cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:54324/0 (socket says 172.21.15.12:54324) 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd174c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41584/0 (socket says 172.21.15.12:41584) 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.030+0000 7effd0f4b640 1 -- 172.21.15.12:0/518842308 learned_addr learned my addr 172.21.15.12:0/518842308 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 -- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 msgr2=0x7effcc1544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 -- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effcc0cd520 msgr2=0x7effcc0cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effcc0cd520 0x7effcc0cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 -- 172.21.15.12:0/518842308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effcc158660 con 0x7effcc155f60 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd0f4b640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd174c640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c3f0 tx=0x7effbc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effc97fa640 1 -- 172.21.15.12:0/518842308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0074e0 con 0x7effcc155f60 2024-04-26T18:07:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effc97fa640 1 -- 172.21.15.12:0/518842308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effbc007680 con 0x7effcc155f60 2024-04-26T18:07:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effcc158940 con 0x7effcc155f60 2024-04-26T18:07:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effc97fa640 1 -- 172.21.15.12:0/518842308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0049e0 con 0x7effcc155f60 2024-04-26T18:07:34.033 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.031+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effcc158f00 con 0x7effcc155f60 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.033+0000 7effc97fa640 1 -- 172.21.15.12:0/518842308 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effbc01a020 con 0x7effcc155f60 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.033+0000 7effc97fa640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.033+0000 7effc97fa640 1 -- 172.21.15.12:0/518842308 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7effbc08b500 con 0x7effcc155f60 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.033+0000 7effd0f4b640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.034+0000 7effd0f4b640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 0x7effac06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effc40094c0 tx=0x7effc400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.034+0000 7effd5fa6740 1 Processor -- start 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.034+0000 7effd5fa6740 1 -- start start 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 0x560f2ff035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec5b40 0x560f2fec4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.036 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560f2fe27d80 con 0x560f2ff03ae0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f2fdc3c20 con 0x560f2fec5b40 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x560f2fe23d40 con 0x560f2fec45e0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effcbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 0x560f2ff035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effcbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41586/0 (socket says 172.21.15.12:41586) 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effcbfff640 1 -- 172.21.15.12:0/712939171 learned_addr learned my addr 172.21.15.12:0/712939171 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd174c640 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec5b40 0x560f2fec4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 -- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec5b40 msgr2=0x560f2fec4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec5b40 0x560f2fec4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 -- 172.21.15.12:0/712939171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 msgr2=0x560f2fec49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 -- 172.21.15.12:0/712939171 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2fc05d80 con 0x560f2fec45e0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effcbfff640 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.035+0000 7effd0f4b640 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 0x560f2ff035a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7effc40079c0 tx=0x7effc4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f95d7772ebe58f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.037 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effc27fc640 1 -- 172.21.15.12:0/712939171 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4017dd0 con 0x560f2fec45e0 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effc27fc640 1 -- 172.21.15.12:0/712939171 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc401b070 con 0x560f2fec45e0 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effc27fc640 1 -- 172.21.15.12:0/712939171 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4015610 con 0x560f2fec45e0 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 -- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 msgr2=0x560f2ff035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 0x560f2ff035a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7effc40079c0 tx=0x7effc4014000 comp rx=0 tx=0).stop 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 -- 172.21.15.12:0/712939171 shutdown_connections 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec5b40 0x560f2fec4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2fec49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 --2- 172.21.15.12:0/712939171 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec45e0 0x560f2ff035a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.038 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 -- 172.21.15.12:0/712939171 >> 172.21.15.12:0/712939171 conn(0x560f2fe8b740 msgr2=0x560f2ff08580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:34.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 -- 172.21.15.12:0/712939171 shutdown_connections 2024-04-26T18:07:34.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.036+0000 7effd5fa6740 1 -- 172.21.15.12:0/712939171 wait complete. 2024-04-26T18:07:34.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.037+0000 7effd5fa6740 1 -- start start 2024-04-26T18:07:34.039 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.037+0000 7effd5fa6740 1 Processor -- start 2024-04-26T18:07:34.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2fefb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2ff03ae0 0x560f2feeead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x560f2fec2c20 con 0x560f2fec45e0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x560f2fdc1840 con 0x560f2ff03ae0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x560f2fec6170 con 0x560f2fec5b40 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd5fa6740 10 client.0 _ll_register_callbacks cb 0x560f2fdc55b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41602/0 (socket says 172.21.15.12:41602) 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 -- 172.21.15.12:0/3119996675 learned_addr learned my addr 172.21.15.12:0/3119996675 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effcbfff640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2fefb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd174c640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2ff03ae0 0x560f2feeead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 -- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 msgr2=0x560f2fefb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2fefb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 -- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2ff03ae0 msgr2=0x560f2feeead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2ff03ae0 0x560f2feeead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 -- 172.21.15.12:0/3119996675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2fc66510 con 0x560f2fec45e0 2024-04-26T18:07:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effd0f4b640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7effc4015640 tx=0x7effc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b450cc6af7f89e14 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.038+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4038060 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7effc4015a30 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc401b070 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7effc403e050 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 10 client.5178 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f2faf9670 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc401b070 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7effc4041020 con 0x560f2fec45e0 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 10 client.5178 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 10 client.5178 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 20 client.5178 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2fefeba0 0x560f2fefef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 4 client.5178 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f2fe35990 con 0x560f2fefeba0 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.039+0000 7effcbfff640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2fefeba0 0x560f2fefef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.040+0000 7effab7fe640 10 client.5178 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.040+0000 7effcbfff640 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2fefeba0 0x560f2fefef80 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b716142738b8286 server_cookie=1b06278275ff9098 in_seq=0 out_seq=0 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effab7fe640 1 -- 172.21.15.12:0/3119996675 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560f2fe35990 con 0x560f2fefeba0 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effab7fe640 10 client.5178 handle_command_reply: tid=0 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 client.5178 shutdown 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 msgr2=0x560f2fefde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7effc4015640 tx=0x7effc4004a40 comp rx=0 tx=0).stop 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 shutdown_connections 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2fefeba0 0x560f2fefef80 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2ff03ae0 0x560f2feeead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2fefb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effab7fe640 0 client.5178 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3119996675 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec45e0 0x560f2fefde40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 >> 172.21.15.12:0/3119996675 conn(0x560f2fe8b740 msgr2=0x560f2feedda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 shutdown_connections 2024-04-26T18:07:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 1 -- 172.21.15.12:0/3119996675 wait complete. 2024-04-26T18:07:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.041+0000 7effd5fa6740 20 client.5178 trim_cache size 0 max 16384 2024-04-26T18:07:34.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.058+0000 7effd5fa6740 1 Processor -- start 2024-04-26T18:07:34.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 -- start start 2024-04-26T18:07:34.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2febff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 0x560f2fec4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7effcc200830 con 0x560f2fec5b40 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effcc1ff710 con 0x560f2fec45e0 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7effcc1f5e50 con 0x560f2ff03ae0 2024-04-26T18:07:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effcbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effcbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41604/0 (socket says 172.21.15.12:41604) 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effcbfff640 1 -- 172.21.15.12:0/3423070489 learned_addr learned my addr 172.21.15.12:0/3423070489 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd0f4b640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2febff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.059+0000 7effd174c640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 0x560f2fec4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 -- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 msgr2=0x560f2fec4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 0x560f2fec4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 -- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 msgr2=0x560f2febff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2febff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 -- 172.21.15.12:0/3423070489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f2fefc390 con 0x560f2fec5b40 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd0f4b640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2febff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd174c640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 0x560f2fec4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effcbfff640 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7effb4009990 tx=0x7effb402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a23cf1ba19549 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effc1ffb640 1 -- 172.21.15.12:0/3423070489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4037040 con 0x560f2fec5b40 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effc1ffb640 1 -- 172.21.15.12:0/3423070489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb402ae50 con 0x560f2fec5b40 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effc1ffb640 1 -- 172.21.15.12:0/3423070489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effb4004030 con 0x560f2fec5b40 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 -- 172.21.15.12:0/3423070489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 msgr2=0x560f2fec49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7effb4009990 tx=0x7effb402e000 comp rx=0 tx=0).stop 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 -- 172.21.15.12:0/3423070489 shutdown_connections 2024-04-26T18:07:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2ff03ae0 0x560f2fec4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2fec5b40 0x560f2fec49c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 --2- 172.21.15.12:0/3423070489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2febff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 -- 172.21.15.12:0/3423070489 >> 172.21.15.12:0/3423070489 conn(0x560f2fe8b740 msgr2=0x560f2fefa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 -- 172.21.15.12:0/3423070489 shutdown_connections 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.060+0000 7effd5fa6740 1 -- 172.21.15.12:0/3423070489 wait complete. 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.061+0000 7effd5fa6740 1 -- start start 2024-04-26T18:07:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.061+0000 7effd5fa6740 1 Processor -- start 2024-04-26T18:07:34.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2ff78cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2ff050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7effcc1fe2f0 con 0x560f2ff03ae0 2024-04-26T18:07:34.070 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7effcc1ff040 con 0x560f2fec45e0 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7effcc1fe9a0 con 0x560f2fec5b40 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd5fa6740 10 client.0 _ll_register_callbacks cb 0x7effc40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41614/0 (socket says 172.21.15.12:41614) 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 -- 172.21.15.12:0/1390430786 learned_addr learned my addr 172.21.15.12:0/1390430786 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:34.071 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd0f4b640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2ff78cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effcbfff640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2ff050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 -- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 msgr2=0x560f2ff050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2ff050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 -- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 msgr2=0x560f2ff78cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2ff78cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:34.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 -- 172.21.15.12:0/1390430786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f2ff03910 con 0x560f2ff03ae0 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effcbfff640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2ff050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effd174c640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7effbc058e70 tx=0x7effbc05d370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b21a31fce38269 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.062+0000 7effab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effbc0615d0 con 0x560f2ff03ae0 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7effbc061770 con 0x560f2ff03ae0 2024-04-26T18:07:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effb402ae50 con 0x560f2ff03ae0 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7effbc0891a0 con 0x560f2ff03ae0 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 10 client.5184 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x560f2feef4f0 con 0x560f2ff03ae0 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effb402ae50 con 0x560f2ff03ae0 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7effbc08b0b0 con 0x560f2ff03ae0 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 10 client.5184 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:34.074 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 10 client.5184 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 20 client.5184 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2ff157b0 0x560f2ff28540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 4 client.5184 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}] 2024-04-26T18:07:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.2, "await_for": 42.0}) -- 0x560f2fe2f800 con 0x560f2ff157b0 2024-04-26T18:07:34.075 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.063+0000 7effd0f4b640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2ff157b0 0x560f2ff28540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.064+0000 7effab7fe640 10 client.5184 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:34.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:34.064+0000 7effd0f4b640 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2ff157b0 0x560f2ff28540 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907b1f65c4aaa53b server_cookie=7dd3e6f44e71a97d in_seq=0 out_seq=0 2024-04-26T18:07:37.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.128+0000 7effab7fe640 1 -- 172.21.15.12:0/1390430786 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560f2fe2f800 con 0x560f2ff157b0 2024-04-26T18:07:37.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.128+0000 7effab7fe640 10 client.5184 handle_command_reply: tid=0 2024-04-26T18:07:37.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.128+0000 7effd5fa6740 1 client.5184 shutdown 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 msgr2=0x560f2ff28000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7effbc058e70 tx=0x7effbc05d370 comp rx=0 tx=0).stop 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 shutdown_connections 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x560f2ff03ae0 0x560f2ff28000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x560f2fec5b40 0x560f2ff050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x560f2ff157b0 0x560f2ff28540 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 --2- 172.21.15.12:0/1390430786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560f2fec45e0 0x560f2ff78cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effab7fe640 0 client.5184 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 >> 172.21.15.12:0/1390430786 conn(0x560f2fe8b740 msgr2=0x560f2fefd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 shutdown_connections 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 1 -- 172.21.15.12:0/1390430786 wait complete. 2024-04-26T18:07:37.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.129+0000 7effd5fa6740 20 client.5184 trim_cache size 0 max 16384 2024-04-26T18:07:37.133 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:07:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:07:37.133 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 30, 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "9063d494": { 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 30, 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:07:37.134 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:07:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:07:37.135 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:07:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 81.2, 2024-04-26T18:07:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:07:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:07:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:07:37.136 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "QUIESCED", 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:37.137 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:37.138 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:37.138 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:07:37.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 msgr2=0x7effac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:37.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 0x7effac06ede0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7effc40094c0 tx=0x7effc400b040 comp rx=0 tx=0).stop 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 msgr2=0x7effcc145ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7effbc00c3f0 tx=0x7effbc001e70 comp rx=0 tx=0).stop 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 shutdown_connections 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc155f60 0x7effcc145ba0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7effcc0cd520 0x7effcc0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7effac06c920 0x7effac06ede0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 --2- 172.21.15.12:0/518842308 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7effcc0c63a0 0x7effcc1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:37.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 >> 172.21.15.12:0/518842308 conn(0x7effcc072930 msgr2=0x7effcc150c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:37.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 shutdown_connections 2024-04-26T18:07:37.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:37.130+0000 7effd31af640 1 -- 172.21.15.12:0/518842308 wait complete. 2024-04-26T18:07:37.143 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9063d494', quiesce took 3.6 seconds. Will release after: 21.2 2024-04-26T18:07:45.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:45.702 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:07:58.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:07:58.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.460+0000 7fc2c9259640 1 Processor -- start 2024-04-26T18:07:58.460 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.460+0000 7fc2c9259640 1 -- start start 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c9259640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2c40b4370 0x7fc2c415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c9259640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c415fa00 con 0x7fc2c40ce070 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c9259640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2c415fce0 con 0x7fc2c40ce450 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c9259640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fc2c40cc090 con 0x7fc2c40b4370 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c2d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc2c40ce070 0x7fc2c415f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51624/0 (socket says 172.21.15.12:51624) 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c2d9d640 1 -- 172.21.15.12:0/2980038539 learned_addr learned my addr 172.21.15.12:0/2980038539 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:07:58.463 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2ba59c640 1 --2- 172.21.15.12:0/2980038539 >> v2:172.21.15.100:3300/0 conn(0x7fc2c40b4370 0x7fc2c415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206581104 0 0) 0x7fc2c415fa00 con 0x7fc2c40ce070 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2b0003520 con 0x7fc2c40ce070 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2181362083 0 0) 0x7fc2b0003520 con 0x7fc2c40ce070 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 >> v2:172.21.15.100:3300/0 conn(0x7fc2c40b4370 msgr2=0x7fc2c415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 --2- 172.21.15.12:0/2980038539 >> v2:172.21.15.100:3300/0 conn(0x7fc2c40b4370 0x7fc2c415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.461+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 >> v1:172.21.15.100:6789/0 conn(0x7fc2c40ce450 legacy=0x7fc2c40ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c415ffc0 con 0x7fc2c40ce070 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fc2b4001670 con 0x7fc2c40ce070 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2ba59c640 1 --2- 172.21.15.12:0/2980038539 >> v2:172.21.15.100:3300/0 conn(0x7fc2c40b4370 0x7fc2c415bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 >> v1:172.21.15.12:6789/0 conn(0x7fc2c40ce070 legacy=0x7fc2c415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 0x7fc2b0003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b0004800 0x7fc2b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2b0005210 0x7fc2b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40cc090 con 0x7fc2b00039b0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b000c140 con 0x7fc2b0004800 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b000c340 con 0x7fc2b0005210 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 0x7fc2b0003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2ba59c640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b0004800 0x7fc2b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c359e640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2b0005210 0x7fc2b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 -- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2b0005210 msgr2=0x7fc2b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2b0005210 0x7fc2b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 -- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b0004800 msgr2=0x7fc2b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b0004800 0x7fc2b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c2d9d640 1 -- 172.21.15.12:0/2980038539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b0003520 con 0x7fc2b00039b0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c359e640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2b0005210 0x7fc2b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.462+0000 7fc2c359e640 1 -- 172.21.15.12:0/2980038539 reap_dead start 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 0x7fc2b0003df0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400c240 tx=0x7fc2b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2be79db239eceb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.465 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4007cf0 con 0x7fc2b00039b0 2024-04-26T18:07:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2b40058d0 con 0x7fc2b00039b0 2024-04-26T18:07:58.466 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c259c640 1 -- 172.21.15.12:0/2980038539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4005d20 con 0x7fc2b00039b0 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c9259640 1 -- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 msgr2=0x7fc2b0003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.463+0000 7fc2c9259640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 0x7fc2b0003df0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2b400c240 tx=0x7fc2b0005830 comp rx=0 tx=0).stop 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.464+0000 7fc2c9259640 1 -- 172.21.15.12:0/2980038539 shutdown_connections 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.464+0000 7fc2c9259640 1 --2- 172.21.15.12:0/2980038539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2b00039b0 0x7fc2b0003df0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.464+0000 7fc2c9259640 1 -- 172.21.15.12:0/2980038539 >> 172.21.15.12:0/2980038539 conn(0x7fc2c40743c0 msgr2=0x7fc2c4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.464+0000 7fc2c9259640 1 -- 172.21.15.12:0/2980038539 shutdown_connections 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.464+0000 7fc2c9259640 1 -- 172.21.15.12:0/2980038539 wait complete. 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.465+0000 7fc2c9259640 1 Processor -- start 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.465+0000 7fc2c9259640 1 -- start start 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 0x7fc2c40cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2c40cb500 0x7fc2c4151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c415bbd0 con 0x7fc2c415d070 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c40cc5c0 con 0x7fc2b00039b0 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c9259640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c415bd50 con 0x7fc2c40cb500 2024-04-26T18:07:58.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44840/0 (socket says 172.21.15.12:44840) 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 -- 172.21.15.12:0/3453633633 learned_addr learned my addr 172.21.15.12:0/3453633633 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 0x7fc2c40cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2ba59c640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2c40cb500 0x7fc2c4151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 -- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2c40cb500 msgr2=0x7fc2c4151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2c40cb500 0x7fc2c4151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 -- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 msgr2=0x7fc2c40cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 0x7fc2c40cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c359e640 1 -- 172.21.15.12:0/3453633633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c415da30 con 0x7fc2c415d070 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.466+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 0x7fc2c40cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2c359e640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ce860 tx=0x7fc2bc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003970 con 0x7fc2c415d070 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc018070 con 0x7fc2c415d070 2024-04-26T18:07:58.471 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c4154f30 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003d50 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.467+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c40c8b70 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.468+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2c4076d20 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.468+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2bc0050d0 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.469+0000 7fc2bbfff640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 0x7fc2a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.469+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fc2bc08ba30 con 0x7fc2c415d070 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.469+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 0x7fc2a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.470+0000 7fc2c2d9d640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 0x7fc2a406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4033000 tx=0x7fc2b4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.473+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2bc022020 con 0x7fc2c415d070 2024-04-26T18:07:58.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.695+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2c4069600 con 0x7fc2c415d070 2024-04-26T18:07:58.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.696+0000 7fc2bbfff640 1 -- 172.21.15.12:0/3453633633 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fc2c415da30 con 0x7fc2c415d070 2024-04-26T18:07:58.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:07:58.696 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:07:58.696 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:07:58.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 msgr2=0x7fc2a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 0x7fc2a406edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4033000 tx=0x7fc2b4009030 comp rx=0 tx=0).stop 2024-04-26T18:07:58.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 msgr2=0x7fc2c415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40ce860 tx=0x7fc2bc00eb90 comp rx=0 tx=0).stop 2024-04-26T18:07:58.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 shutdown_connections 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2c415d070 0x7fc2c415d4f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fc2a406c8f0 0x7fc2a406edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc2c40cb500 0x7fc2c4151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 --2- 172.21.15.12:0/3453633633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2b00039b0 0x7fc2c40cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 >> 172.21.15.12:0/3453633633 conn(0x7fc2c40743c0 msgr2=0x7fc2c415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 shutdown_connections 2024-04-26T18:07:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.698+0000 7fc2c9259640 1 -- 172.21.15.12:0/3453633633 wait complete. 2024-04-26T18:07:58.709 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 9063d494 --release --await' 2024-04-26T18:07:58.709 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 9063d494 --release --await 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.816+0000 7f26336cf640 1 Processor -- start 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.816+0000 7f26336cf640 1 -- start start 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f262c0d1510 0x7f262c15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f262c0d18f0 0x7f262c0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0cd620 0x7f262c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f262c0ce5e0 con 0x7f262c0d1510 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f262c0ce8c0 con 0x7f262c0d18f0 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f26336cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0ceba0 con 0x7f262c0cd620 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f262c0d1510 0x7f262c15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f262c0d1510 0x7f262c15fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44854/0 (socket says 172.21.15.12:44854) 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 -- 172.21.15.12:0/2320128900 learned_addr learned my addr 172.21.15.12:0/2320128900 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f2631c6c640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0cd620 0x7f262c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 -- 172.21.15.12:0/2320128900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0cd620 msgr2=0x7f262c0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0cd620 0x7f262c0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 -- 172.21.15.12:0/2320128900 >> v2:172.21.15.100:3300/0 conn(0x7f262c0d18f0 msgr2=0x7f262c0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f2630c6a640 1 --2- 172.21.15.12:0/2320128900 >> v2:172.21.15.100:3300/0 conn(0x7f262c0d18f0 0x7f262c0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 --2- 172.21.15.12:0/2320128900 >> v2:172.21.15.100:3300/0 conn(0x7f262c0d18f0 0x7f262c0c61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.817+0000 7f263146b640 1 -- 172.21.15.12:0/2320128900 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c15f100 con 0x7f262c0d1510 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f263146b640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0d1510 0x7f262c15fbe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f262c073510 tx=0x7f262802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e0a2fdfc576e7d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f2623fff640 1 -- 172.21.15.12:0/2320128900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628037070 con 0x7f262c0d1510 2024-04-26T18:07:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f2623fff640 1 -- 172.21.15.12:0/2320128900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2628032440 con 0x7f262c0d1510 2024-04-26T18:07:58.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f2623fff640 1 -- 172.21.15.12:0/2320128900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628032810 con 0x7f262c0d1510 2024-04-26T18:07:58.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f26336cf640 1 -- 172.21.15.12:0/2320128900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0d1510 msgr2=0x7f262c15fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.818+0000 7f26336cf640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0d1510 0x7f262c15fbe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f262c073510 tx=0x7f262802a270 comp rx=0 tx=0).stop 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 -- 172.21.15.12:0/2320128900 shutdown_connections 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0cd620 0x7f262c0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 --2- 172.21.15.12:0/2320128900 >> v2:172.21.15.100:3300/0 conn(0x7f262c0d18f0 0x7f262c0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 --2- 172.21.15.12:0/2320128900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0d1510 0x7f262c15fbe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 -- 172.21.15.12:0/2320128900 >> 172.21.15.12:0/2320128900 conn(0x7f262c072930 msgr2=0x7f262c072d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 -- 172.21.15.12:0/2320128900 shutdown_connections 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.819+0000 7f26336cf640 1 -- 172.21.15.12:0/2320128900 wait complete. 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.820+0000 7f26336cf640 1 Processor -- start 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.820+0000 7f26336cf640 1 -- start start 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.820+0000 7f26336cf640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262c0d1510 0x7f262c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0d18f0 0x7f262c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f262c0ccc70 con 0x7f262c0cd620 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f262c15f6c0 con 0x7f262c0d1510 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f262c0ce200 con 0x7f262c0d18f0 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44858/0 (socket says 172.21.15.12:44858) 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 -- 172.21.15.12:0/3761730069 learned_addr learned my addr 172.21.15.12:0/3761730069 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 -- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0d18f0 msgr2=0x7f262c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0d18f0 0x7f262c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 -- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262c0d1510 msgr2=0x7f262c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262c0d1510 0x7f262c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 -- 172.21.15.12:0/3761730069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f262c152840 con 0x7f262c0cd620 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f263146b640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2628000c00 tx=0x7f26280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f2621ffb640 1 -- 172.21.15.12:0/3761730069 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628037040 con 0x7f262c0cd620 2024-04-26T18:07:58.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f2621ffb640 1 -- 172.21.15.12:0/3761730069 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2628042070 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f262c151710 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.821+0000 7f2621ffb640 1 -- 172.21.15.12:0/3761730069 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628030bb0 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.822+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f262c0caff0 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.823+0000 7f2621ffb640 1 -- 172.21.15.12:0/3761730069 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2628047460 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.823+0000 7f2621ffb640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 0x7f261006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.824+0000 7f2621ffb640 1 -- 172.21.15.12:0/3761730069 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f26280acb70 con 0x7f262c0cd620 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.824+0000 7f2630c6a640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 0x7f261006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.824+0000 7f26363e2740 1 Processor -- start 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.824+0000 7f2630c6a640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 0x7f261006ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f262c0b6e40 tx=0x7f261c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.824+0000 7f26363e2740 1 -- start start 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f1291890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f1291dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.830 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6f11f6040 con 0x55a6f12914b0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a6f1191b60 con 0x55a6f1292a10 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55a6f11f2000 con 0x55a6f12d09b0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44872/0 (socket says 172.21.15.12:44872) 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 -- 172.21.15.12:0/2615625849 learned_addr learned my addr 172.21.15.12:0/2615625849 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f2630c6a640 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f1291890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f2631c6c640 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f1291dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 -- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 msgr2=0x55a6f1291890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f1291890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 -- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 msgr2=0x55a6f1291dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f1291dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.825+0000 7f263146b640 1 -- 172.21.15.12:0/2615625849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6f11869c0 con 0x55a6f12914b0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f263146b640 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2628082b10 tx=0x7f2628079dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468890fec5ad7403 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f2616ffd640 1 -- 172.21.15.12:0/2615625849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262807a460 con 0x55a6f12914b0 2024-04-26T18:07:58.831 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f2616ffd640 1 -- 172.21.15.12:0/2615625849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262807e810 con 0x55a6f12914b0 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f2616ffd640 1 -- 172.21.15.12:0/2615625849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628083040 con 0x55a6f12914b0 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 -- 172.21.15.12:0/2615625849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 msgr2=0x55a6f12d0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2628082b10 tx=0x7f2628079dc0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 -- 172.21.15.12:0/2615625849 shutdown_connections 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f1291dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f1291890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 --2- 172.21.15.12:0/2615625849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12d0470 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 -- 172.21.15.12:0/2615625849 >> 172.21.15.12:0/2615625849 conn(0x55a6f1258930 msgr2=0x55a6f12d5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 -- 172.21.15.12:0/2615625849 shutdown_connections 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.826+0000 7f26363e2740 1 -- 172.21.15.12:0/2615625849 wait complete. 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.827+0000 7f26363e2740 1 -- start start 2024-04-26T18:07:58.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.827+0000 7f26363e2740 1 Processor -- start 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f12b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f12e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55a6f1191b60 con 0x55a6f12914b0 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55a6f118f4f0 con 0x55a6f1292a10 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55a6f11f6040 con 0x55a6f12d09b0 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f26363e2740 10 client.0 _ll_register_callbacks cb 0x55a6f11ecc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44882/0 (socket says 172.21.15.12:44882) 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 -- 172.21.15.12:0/2332306986 learned_addr learned my addr 172.21.15.12:0/2332306986 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f2630c6a640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f12b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f2631c6c640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f12e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 -- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 msgr2=0x55a6f12e4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f12e4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 -- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 msgr2=0x55a6f12b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f12b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 -- 172.21.15.12:0/2332306986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6f0f07920 con 0x55a6f12914b0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.828+0000 7f263146b640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f26280aacb0 tx=0x7f2628007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ed5a3ba9cb31c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628097060 con 0x55a6f12914b0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f262807a6c0 con 0x55a6f12914b0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f262807e810 con 0x55a6f12914b0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f262807a460 con 0x55a6f12914b0 2024-04-26T18:07:58.837 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 10 client.5202 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a6f0fd3d30 con 0x55a6f12914b0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f262807e810 con 0x55a6f12914b0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f262803a030 con 0x55a6f12914b0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 10 client.5202 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 10 client.5202 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 20 client.5202 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f1291ec0 0x55a6f12e5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 4 client.5202 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6f11c9a00 con 0x55a6f1291ec0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.829+0000 7f2630c6a640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f1291ec0 0x55a6f12e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.830+0000 7f260bfff640 10 client.5202 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.830+0000 7f2630c6a640 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f1291ec0 0x55a6f12e5310 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=658627187eca86f7 server_cookie=217137761a1c0fb6 in_seq=0 out_seq=0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.830+0000 7f260bfff640 1 -- 172.21.15.12:0/2332306986 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55a6f11c9a00 con 0x55a6f1291ec0 2024-04-26T18:07:58.838 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.830+0000 7f260bfff640 10 client.5202 handle_command_reply: tid=0 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.830+0000 7f26363e2740 1 client.5202 shutdown 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 msgr2=0x55a6f12ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f26280aacb0 tx=0x7f2628007000 comp rx=0 tx=0).stop 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 shutdown_connections 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f12e4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f1291ec0 0x55a6f12e5310 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f1292a10 0x55a6f12b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f260bfff640 0 client.5202 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 --2- 172.21.15.12:0/2332306986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12914b0 0x55a6f12ce7c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 >> 172.21.15.12:0/2332306986 conn(0x55a6f1258930 msgr2=0x55a6f12ba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 shutdown_connections 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 1 -- 172.21.15.12:0/2332306986 wait complete. 2024-04-26T18:07:58.839 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.831+0000 7f26363e2740 20 client.5202 trim_cache size 0 max 16384 2024-04-26T18:07:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.848+0000 7f26363e2740 1 Processor -- start 2024-04-26T18:07:58.848 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.848+0000 7f26363e2740 1 -- start start 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f133f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f262c2009e0 con 0x55a6f1292a10 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f262c1ff8c0 con 0x55a6f12914b0 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f262c1fde20 con 0x55a6f12d09b0 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44898/0 (socket says 172.21.15.12:44898) 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 -- 172.21.15.12:0/221290052 learned_addr learned my addr 172.21.15.12:0/221290052 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 -- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 msgr2=0x55a6f133f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f133f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 -- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 msgr2=0x55a6f12d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.851 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 -- 172.21.15.12:0/221290052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6f12ce520 con 0x55a6f1292a10 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f2630c6a640 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c830 tx=0x7f261c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f85374ee7e0877 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26167fc640 1 -- 172.21.15.12:0/221290052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c019040 con 0x55a6f1292a10 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26167fc640 1 -- 172.21.15.12:0/221290052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c020ab0 con 0x55a6f1292a10 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.849+0000 7f26167fc640 1 -- 172.21.15.12:0/221290052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f261c020e60 con 0x55a6f1292a10 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- 172.21.15.12:0/221290052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 msgr2=0x55a6f133f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f261c00c830 tx=0x7f261c014000 comp rx=0 tx=0).stop 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- 172.21.15.12:0/221290052 shutdown_connections 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f12d09b0 0x55a6f133f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f1292a10 0x55a6f133f150 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 --2- 172.21.15.12:0/221290052 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12d5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- 172.21.15.12:0/221290052 >> 172.21.15.12:0/221290052 conn(0x55a6f1258930 msgr2=0x55a6f128eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- 172.21.15.12:0/221290052 shutdown_connections 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- 172.21.15.12:0/221290052 wait complete. 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.850+0000 7f26363e2740 1 -- start start 2024-04-26T18:07:58.852 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 Processor -- start 2024-04-26T18:07:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f1292a10 0x55a6f1341eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f262c1fe470 con 0x55a6f12d09b0 2024-04-26T18:07:58.855 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f262c1ff1f0 con 0x55a6f12914b0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.851+0000 7f26363e2740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f262c1feb20 con 0x55a6f1292a10 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f26363e2740 10 client.0 _ll_register_callbacks cb 0x7f2624007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44900/0 (socket says 172.21.15.12:44900) 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 -- 172.21.15.12:0/3186785073 learned_addr learned my addr 172.21.15.12:0/3186785073 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2630c6a640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f1292a10 0x55a6f1341eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 -- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f1292a10 msgr2=0x55a6f1341eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f1292a10 0x55a6f1341eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 -- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 msgr2=0x55a6f12c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12c6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 -- 172.21.15.12:0/3186785073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6f133fbd0 con 0x55a6f12d09b0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f2631c6c640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55a6f12b98c0 tx=0x7f262400d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbf624828a00039 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:07:58.856 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f260bfff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262400dbd0 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f262400dd70 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f261c020ab0 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2624003990 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f26363e2740 10 client.5208 fetch_fsmap learned FSMap version 9 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.852+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55a6f1204380 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f261c020ab0 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f2624021050 con 0x55a6f12d09b0 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 10 client.5208 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 10 client.5208 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 20 client.5208 populate_metadata read hostname 'smithi012' 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 4 client.5208 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9063d494", "release": true, "await": true}] 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9063d494", "release": true, "await": true}) -- 0x55a6f12b9210 con 0x55a6f133e110 2024-04-26T18:07:58.857 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f263146b640 1 -- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 msgr2=0x55a6f134e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-26T18:07:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f263146b640 1 -- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 msgr2=0x55a6f134e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-26T18:07:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-26T18:07:58.858 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:58.853+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-26T18:07:59.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f263146b640 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18ebc23fd88d41b7 server_cookie=35bc5e2ceca4fa6d in_seq=0 out_seq=0 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f260bfff640 10 client.5208 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f260bfff640 1 -- 172.21.15.12:0/3186785073 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55a6f12b9210 con 0x55a6f133e110 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f260bfff640 10 client.5208 handle_command_reply: tid=0 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.054+0000 7f26363e2740 1 client.5208 shutdown 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 msgr2=0x55a6f133dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55a6f12b98c0 tx=0x7f262400d380 comp rx=0 tx=0).stop 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 shutdown_connections 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a6f12d09b0 0x55a6f133dbd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55a6f1292a10 0x55a6f1341eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55a6f133e110 0x55a6f134e9b0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 --2- 172.21.15.12:0/3186785073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55a6f12914b0 0x55a6f12c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f260bfff640 0 client.5208 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:07:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 >> 172.21.15.12:0/3186785073 conn(0x55a6f1258930 msgr2=0x55a6f12d5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 shutdown_connections 2024-04-26T18:07:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 1 -- 172.21.15.12:0/3186785073 wait complete. 2024-04-26T18:07:59.057 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26363e2740 20 client.5208 trim_cache size 0 max 16384 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 32, 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": { 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "9063d494": { 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "version": 32, 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "age_ref": 0.0, 2024-04-26T18:07:59.058 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "timeout": 60.0, 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "expiration": 81.2, 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "members": { 2024-04-26T18:07:59.059 INFO:teuthology.orchestra.run.smithi012.stdout: "file:/": { 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "excluded": false, 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "state": { 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "RELEASED", 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: "age": 0.0 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:59.060 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:59.061 INFO:teuthology.orchestra.run.smithi012.stdout: } 2024-04-26T18:07:59.061 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.055+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 msgr2=0x7f261006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 0x7f261006ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f262c0b6e40 tx=0x7f261c008040 comp rx=0 tx=0).stop 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 msgr2=0x7f262c152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2628000c00 tx=0x7f26280046c0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 shutdown_connections 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f261006c920 0x7f261006ede0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f262c0d18f0 0x7f262c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f262c0d1510 0x7f262c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 --2- 172.21.15.12:0/3761730069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f262c0cd620 0x7f262c152300 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:07:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 >> 172.21.15.12:0/3761730069 conn(0x7f262c072930 msgr2=0x7f262c150740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:07:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 shutdown_connections 2024-04-26T18:07:59.063 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:07:59.056+0000 7f26336cf640 1 -- 172.21.15.12:0/3761730069 wait complete. 2024-04-26T18:07:59.067 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9063d494', seconds elapsed: 25.5 2024-04-26T18:08:15.763 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:15.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:23.295 INFO:tasks.workunit.client.0.smithi012.stderr:Updating files: 2% (333/12492) Updating files: 3% (375/12492) Updating files: 3% (480/12492) Updating files: 4% (500/12492) Updating files: 4% (600/12492) Updating files: 5% (625/12492) Updating files: 6% (750/12492) Updating files: 6% (849/12492) Updating files: 7% (875/12492) Updating files: 7% (995/12492) Updating files: 8% (1000/12492) Updating files: 8% (1017/12492) Updating files: 8% (1035/12492) Updating files: 9% (1125/12492) Updating files: 9% (1139/12492) Updating files: 10% (1250/12492) Updating files: 10% (1331/12492) Updating files: 11% (1375/12492) Updating files: 11% (1461/12492) Updating files: 11% (1482/12492) Updating files: 12% (1500/12492) Updating files: 13% (1624/12492) Updating files: 13% (1644/12492) Updating files: 13% (1745/12492) Updating files: 14% (1749/12492) Updating files: 14% (1774/12492) Updating files: 14% (1825/12492) Updating files: 15% (1874/12492) Updating files: 16% (1999/12492) Updating files: 16% (2022/12492) Updating files: 17% (2124/12492) Updating files: 18% (2249/12492) Updating files: 19% (2374/12492) Updating files: 19% (2392/12492) Updating files: 20% (2499/12492) Updating files: 20% (2556/12492) Updating files: 21% (2624/12492) Updating files: 21% (2653/12492) Updating files: 22% (2749/12492) Updating files: 23% (2874/12492) Updating files: 23% (2896/12492) Updating files: 23% (2930/12492) Updating files: 24% (2999/12492) Updating files: 24% (3089/12492) Updating files: 25% (3123/12492) Updating files: 25% (3217/12492) Updating files: 26% (3248/12492) Updating files: 26% (3311/12492) Updating files: 27% (3373/12492) Updating files: 28% (3498/12492) Updating files: 28% (3520/12492) Updating files: 29% (3623/12492) Updating files: 29% (3692/12492) Updating files: 30% (3748/12492) Updating files: 30% (3797/12492) Updating files: 31% (3873/12492) Updating files: 32% (3998/12492) Updating files: 32% (4003/12492) Updating files: 33% (4123/12492) Updating files: 34% (4248/12492) Updating files: 34% (4256/12492) Updating files: 35% (4373/12492) Updating files: 36% (4498/12492) Updating files: 36% (4550/12492) Updating files: 36% (4556/12492) Updating files: 37% (4623/12492) Updating files: 38% (4747/12492) Updating files: 39% (4872/12492) Updating files: 39% (4877/12492) Updating files: 40% (4997/12492) Updating files: 41% (5122/12492) Updating files: 42% (5247/12492) Updating files: 42% (5260/12492) Updating files: 42% (5344/12492) Updating files: 43% (5372/12492) Updating files: 44% (5497/12492) Updating files: 44% (5585/12492) Updating files: 44% (5606/12492) Updating files: 45% (5622/12492) Updating files: 46% (5747/12492) Updating files: 47% (5872/12492) Updating files: 47% (5984/12492) Updating files: 48% (5997/12492) Updating files: 48% (6081/12492) Updating files: 49% (6122/12492) Updating files: 50% (6246/12492) Updating files: 51% (6371/12492) Updating files: 51% (6377/12492) Updating files: 52% (6496/12492) Updating files: 52% (6560/12492) Updating files: 52% (6562/12492) Updating files: 53% (6621/12492) Updating files: 53% (6682/12492) Updating files: 54% (6746/12492) Updating files: 54% (6798/12492) Updating files: 55% (6871/12492) Updating files: 56% (6996/12492) Updating files: 57% (7121/12492) Updating files: 57% (7145/12492) Updating files: 58% (7246/12492) Updating files: 58% (7248/12492) Updating files: 59% (7371/12492) Updating files: 60% (7496/12492) Updating files: 60% (7516/12492) Updating files: 60% (7614/12492) Updating files: 61% (7621/12492) Updating files: 61% (7638/12492) Updating files: 62% (7746/12492) Updating files: 63% (7870/12492) Updating files: 64% (7995/12492) Updating files: 64% (8062/12492) Updating files: 64% (8066/12492) Updating files: 64% (8067/12492) Updating files: 65% (8120/12492) Updating files: 65% (8142/12492) Updating files: 65% (8220/12492) Updating files: 66% (8245/12492) Updating files: 67% (8370/12492) Updating files: 67% (8448/12492) Updating files: 68% (8495/12492) Updating files: 69% (8620/12492) Updating files: 69% (8646/12492) Updating files: 70% (8745/12492) Updating files: 71% (8870/12492) Updating files: 71% (8946/12492) Updating files: 72% (8995/12492) Updating files: 73% (9120/12492) Updating files: 73% (9224/12492) Updating files: 73% (9235/12492) Updating files: 74% (9245/12492) Updating files: 74% (9326/12492) Updating files: 75% (9369/12492) Updating files: 76% (9494/12492) Updating files: 76% (9567/12492) Updating files: 77% (9619/12492) Updating files: 78% (9744/12492) Updating files: 78% (9849/12492) Updating files: 79% (9869/12492) Updating files: 79% (9964/12492) Updating files: 79% (9986/12492) Updating files: 79% (9992/12492) Updating files: 80% (9994/12492) Updating files: 80% (10014/12492) Updating files: 81% (10119/12492) Updating files: 81% (10160/12492) Updating files: 82% (10244/12492) Updating files: 82% (10358/12492) Updating files: 83% (10369/12492) Updating files: 84% (10494/12492) Updating files: 84% (10555/12492) Updating files: 84% (10596/12492) Updating files: 85% (10619/12492) Updating files: 85% (10638/12492) Updating files: 86% (10744/12492) Updating files: 87% (10869/12492) Updating files: 88% (10993/12492) Updating files: 88% (11086/12492) Updating files: 89% (11118/12492) Updating files: 89% (11242/12492) Updating files: 90% (11243/12492) Updating files: 91% (11368/12492) Updating files: 91% (11491/12492) Updating files: 92% (11493/12492) Updating files: 93% (11618/12492) Updating files: 94% (11743/12492) Updating files: 94% (11822/12492) Updating files: 95% (11868/12492) Updating files: 95% (11918/12492) Updating files: 96% (11993/12492) Updating files: 97% (12118/12492) Updating files: 97% (12138/12492) Updating files: 98% (12243/12492) Updating files: 99% (12368/12492) Updating files: 100% (12492/12492) Updating files: 100% (12492/12492), done. 2024-04-26T18:08:23.957 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-04-26T18:08:23.958 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-04-26T18:08:23.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T18:08:24.248 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi012 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-26T18:08:24.628 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0efdb25c8601412c928dd3030a6edbb3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi012 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-26T18:08:24.631 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-26T18:08:24.641 INFO:tasks.quiescer:joining Quiescers 2024-04-26T18:08:24.642 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-26T18:08:24.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:08:24.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.754+0000 7fae0ea07640 1 Processor -- start 2024-04-26T18:08:24.754 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.754+0000 7fae0ea07640 1 -- start start 2024-04-26T18:08:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0ea07640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fae080cc930 0x7fae080cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0ea07640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae081561a0 con 0x7fae080cb730 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0ea07640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0815be00 con 0x7fae08155dc0 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0ea07640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fae0815f1c0 con 0x7fae080cc930 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0cfa4640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae080cb730 0x7fae0815f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46540/0 (socket says 172.21.15.12:46540) 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae0cfa4640 1 -- 172.21.15.12:0/386870660 learned_addr learned my addr 172.21.15.12:0/386870660 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae077fe640 1 --2- 172.21.15.12:0/386870660 >> v2:172.21.15.100:3300/0 conn(0x7fae080cc930 0x7fae080cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133540132 0 0) 0x7fae081561a0 con 0x7fae080cb730 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadf0003520 con 0x7fae080cb730 2024-04-26T18:08:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213735771 0 0) 0x7fadf0003520 con 0x7fae080cb730 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 >> v2:172.21.15.100:3300/0 conn(0x7fae080cc930 msgr2=0x7fae080cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 --2- 172.21.15.12:0/386870660 >> v2:172.21.15.100:3300/0 conn(0x7fae080cc930 0x7fae080cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 >> v1:172.21.15.100:6789/0 conn(0x7fae08155dc0 legacy=0x7fae08071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0815c0e0 con 0x7fae080cb730 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7fae000019f0 con 0x7fae080cb730 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 >> v1:172.21.15.12:6789/0 conn(0x7fae080cb730 legacy=0x7fae0815f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 0x7fadf0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf0004800 0x7fadf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00051c0 0x7fadf000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae0815f1c0 con 0x7fadf0004800 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fadf000c070 con 0x7fadf00039b0 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.755+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fadf000c270 con 0x7fadf00051c0 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 0x7fadf0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae077fe640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf0004800 0x7fadf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae0cfa4640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00051c0 0x7fadf000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 -- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00051c0 msgr2=0x7fadf000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00051c0 0x7fadf000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 -- 172.21.15.12:0/386870660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf0004800 msgr2=0x7fadf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf0004800 0x7fadf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae07fff640 1 -- 172.21.15.12:0/386870660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf0003520 con 0x7fadf00039b0 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae0cfa4640 1 -- 172.21.15.12:0/386870660 reap_dead start 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.756+0000 7fae077fe640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadf0004800 0x7fadf0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae07fff640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 0x7fadf0003dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001750 tx=0x7fadf0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8a940b43d0c8068 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8001370 con 0x7fadf00039b0 2024-04-26T18:08:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf80052d0 con 0x7fadf00039b0 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae06ffd640 1 -- 172.21.15.12:0/386870660 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf802abe0 con 0x7fadf00039b0 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 -- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 msgr2=0x7fadf0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 0x7fadf0003dd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fadf8001750 tx=0x7fadf0005830 comp rx=0 tx=0).stop 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 -- 172.21.15.12:0/386870660 shutdown_connections 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 --2- 172.21.15.12:0/386870660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadf00039b0 0x7fadf0003dd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 -- 172.21.15.12:0/386870660 >> 172.21.15.12:0/386870660 conn(0x7fae08071ec0 msgr2=0x7fae080722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.757+0000 7fae0ea07640 1 -- 172.21.15.12:0/386870660 shutdown_connections 2024-04-26T18:08:24.763 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.758+0000 7fae0ea07640 1 -- 172.21.15.12:0/386870660 wait complete. 2024-04-26T18:08:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.759+0000 7fae0ea07640 1 Processor -- start 2024-04-26T18:08:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.759+0000 7fae0ea07640 1 -- start start 2024-04-26T18:08:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 0x7fae081f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 0x7fae0814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fae0815c980 con 0x7fae081f2d90 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fae0815c6a0 con 0x7fae08152b70 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fae0815baa0 con 0x7fadf00039b0 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41122/0 (socket says 172.21.15.12:41122) 2024-04-26T18:08:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 -- 172.21.15.12:0/1799695485 learned_addr learned my addr 172.21.15.12:0/1799695485 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0cfa4640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 0x7fae0814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae07fff640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 0x7fae081f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 -- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 msgr2=0x7fae081f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 0x7fae081f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 -- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 msgr2=0x7fae0814fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 0x7fae0814fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 -- 172.21.15.12:0/1799695485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae081f5d70 con 0x7fae081f2d90 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae07fff640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 0x7fae081f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0cfa4640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 0x7fae0814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae077fe640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011c00 tx=0x7fadfc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc009690 con 0x7fae081f2d90 2024-04-26T18:08:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadfc011cf0 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011ea0 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae081f2000 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.760+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae081f25c0 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.761+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae080b5840 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.762+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fadfc012040 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.762+0000 7fae04ff9640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 0x7fadf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.762+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fadfc08c4e0 con 0x7fae081f2d90 2024-04-26T18:08:24.770 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.763+0000 7fae07fff640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 0x7fadf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:24.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.763+0000 7fae07fff640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 0x7fadf406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fadf8032000 tx=0x7fadf802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:24.771 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.767+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fae080b5840 con 0x7fae081f2d90 2024-04-26T18:08:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.992+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae08076d20 con 0x7fae081f2d90 2024-04-26T18:08:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.992+0000 7fae04ff9640 1 -- 172.21.15.12:0/1799695485 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7fadfc019030 con 0x7fae081f2d90 2024-04-26T18:08:24.993 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:24.993 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:08:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:08:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 msgr2=0x7fadf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 0x7fadf406edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fadf8032000 tx=0x7fadf802e000 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 msgr2=0x7fae081f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadfc011c00 tx=0x7fadfc00f610 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 shutdown_connections 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae08152b70 0x7fae0814fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae081f2d90 0x7fae081f5830 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fadf406c8f0 0x7fadf406edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 --2- 172.21.15.12:0/1799695485 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fadf00039b0 0x7fae081f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 >> 172.21.15.12:0/1799695485 conn(0x7fae08071ec0 msgr2=0x7fae080cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 shutdown_connections 2024-04-26T18:08:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:24.994+0000 7fae0ea07640 1 -- 172.21.15.12:0/1799695485 wait complete. 2024-04-26T18:08:25.007 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --cancel --all' 2024-04-26T18:08:25.007 DEBUG:teuthology.orchestra.run.smithi012:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --cancel --all 2024-04-26T18:08:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.121+0000 7fe6875e9640 1 Processor -- start 2024-04-26T18:08:25.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.121+0000 7fe6875e9640 1 -- start start 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe6875e9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe680155d30 0x7fe6800714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe6875e9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6800c9df0 0x7fe6800c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe6875e9640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe68015c500 con 0x7fe68006cd20 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe6875e9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800b1d00 con 0x7fe6800c9df0 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe6875e9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fe68015ca70 con 0x7fe680155d30 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe684b84640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6800c9df0 0x7fe6800c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe685b86640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe68006cd20 0x7fe68015f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46550/0 (socket says 172.21.15.12:46550) 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe685b86640 1 -- 172.21.15.12:0/4198787995 learned_addr learned my addr 172.21.15.12:0/4198787995 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe685385640 1 --2- 172.21.15.12:0/4198787995 >> v2:172.21.15.100:3300/0 conn(0x7fe680155d30 0x7fe6800714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe684b84640 1 -- 172.21.15.12:0/4198787995 >> v2:172.21.15.100:3300/0 conn(0x7fe680155d30 msgr2=0x7fe6800714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe684b84640 1 --2- 172.21.15.12:0/4198787995 >> v2:172.21.15.100:3300/0 conn(0x7fe680155d30 0x7fe6800714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe684b84640 1 -- 172.21.15.12:0/4198787995 >> v1:172.21.15.12:6789/0 conn(0x7fe68006cd20 legacy=0x7fe68015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe684b84640 1 -- 172.21.15.12:0/4198787995 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68015c790 con 0x7fe6800c9df0 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.122+0000 7fe677fff640 1 -- 172.21.15.12:0/4198787995 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1110489958 0 0) 0x7fe68015c500 con 0x7fe68006cd20 2024-04-26T18:08:25.124 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.123+0000 7fe684b84640 1 --2- 172.21.15.12:0/4198787995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6800c9df0 0x7fe6800c4b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe68006f700 tx=0x7fe67002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47016cdec120a33f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.123+0000 7fe677fff640 1 -- 172.21.15.12:0/4198787995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670037070 con 0x7fe6800c9df0 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.123+0000 7fe677fff640 1 -- 172.21.15.12:0/4198787995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe670032440 con 0x7fe6800c9df0 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.123+0000 7fe677fff640 1 -- 172.21.15.12:0/4198787995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670032810 con 0x7fe6800c9df0 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 -- 172.21.15.12:0/4198787995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6800c9df0 msgr2=0x7fe6800c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 --2- 172.21.15.12:0/4198787995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6800c9df0 0x7fe6800c4b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe68006f700 tx=0x7fe67002a1a0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 -- 172.21.15.12:0/4198787995 shutdown_connections 2024-04-26T18:08:25.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 --2- 172.21.15.12:0/4198787995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6800c9df0 0x7fe6800c4b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 --2- 172.21.15.12:0/4198787995 >> v2:172.21.15.100:3300/0 conn(0x7fe680155d30 0x7fe6800714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 -- 172.21.15.12:0/4198787995 >> 172.21.15.12:0/4198787995 conn(0x7fe680071e30 msgr2=0x7fe680072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 -- 172.21.15.12:0/4198787995 shutdown_connections 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.124+0000 7fe6875e9640 1 -- 172.21.15.12:0/4198787995 wait complete. 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.125+0000 7fe6875e9640 1 Processor -- start 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.125+0000 7fe6875e9640 1 -- start start 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 0x7fe6800cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe680155d30 0x7fe6800ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800706b0 con 0x7fe68006cd20 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800703d0 con 0x7fe6800c9df0 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe680070990 con 0x7fe680155d30 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41140/0 (socket says 172.21.15.12:41140) 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 -- 172.21.15.12:0/3401662270 learned_addr learned my addr 172.21.15.12:0/3401662270 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe684b84640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 0x7fe6800cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685b86640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe680155d30 0x7fe6800ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 -- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe680155d30 msgr2=0x7fe6800ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe680155d30 0x7fe6800ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 -- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 msgr2=0x7fe6800cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 0x7fe6800cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 -- 172.21.15.12:0/3401662270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6800cd7c0 con 0x7fe68006cd20 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe684b84640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 0x7fe6800cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe685385640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00d800 tx=0x7fe67c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe675ffb640 1 -- 172.21.15.12:0/3401662270 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c00b6c0 con 0x7fe68006cd20 2024-04-26T18:08:25.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe675ffb640 1 -- 172.21.15.12:0/3401662270 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c019070 con 0x7fe68006cd20 2024-04-26T18:08:25.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6801f50a0 con 0x7fe68006cd20 2024-04-26T18:08:25.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.126+0000 7fe675ffb640 1 -- 172.21.15.12:0/3401662270 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c00ba80 con 0x7fe68006cd20 2024-04-26T18:08:25.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.127+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801f5660 con 0x7fe68006cd20 2024-04-26T18:08:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.128+0000 7fe675ffb640 1 -- 172.21.15.12:0/3401662270 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe67c00bc20 con 0x7fe68006cd20 2024-04-26T18:08:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.129+0000 7fe675ffb640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 0x7fe66406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.129+0000 7fe675ffb640 1 -- 172.21.15.12:0/3401662270 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fe67c08c470 con 0x7fe68006cd20 2024-04-26T18:08:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.129+0000 7fe684b84640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 0x7fe66406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.140 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.129+0000 7fe684b84640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 0x7fe66406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe670034000 tx=0x7fe67002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 Processor -- start 2024-04-26T18:08:25.141 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 -- start start 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0a2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55832e005c70 con 0x55832e09ce40 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55832dfa1690 con 0x55832e0dc4a0 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.130+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55832e001c30 con 0x55832e09d220 2024-04-26T18:08:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41150/0 (socket says 172.21.15.12:41150) 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 -- 172.21.15.12:0/2306644188 learned_addr learned my addr 172.21.15.12:0/2306644188 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe684b84640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685b86640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 -- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 msgr2=0x55832e0a2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0a2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 -- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 msgr2=0x55832e0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 -- 172.21.15.12:0/2306644188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55832dde3a20 con 0x55832e09ce40 2024-04-26T18:08:25.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685b86640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe685385640 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe67c08a430 tx=0x7fe67c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f51069e83d0af55 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe66affd640 1 -- 172.21.15.12:0/2306644188 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c072020 con 0x55832e09ce40 2024-04-26T18:08:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe66affd640 1 -- 172.21.15.12:0/2306644188 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c05e070 con 0x55832e09ce40 2024-04-26T18:08:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.131+0000 7fe66affd640 1 -- 172.21.15.12:0/2306644188 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0628a0 con 0x55832e09ce40 2024-04-26T18:08:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- 172.21.15.12:0/2306644188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 msgr2=0x55832e0dc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe67c08a430 tx=0x7fe67c01c360 comp rx=0 tx=0).stop 2024-04-26T18:08:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- 172.21.15.12:0/2306644188 shutdown_connections 2024-04-26T18:08:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0a2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/2306644188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09ce40 0x55832e0dc9f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- 172.21.15.12:0/2306644188 >> 172.21.15.12:0/2306644188 conn(0x55832e09e410 msgr2=0x55832e0a0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- 172.21.15.12:0/2306644188 shutdown_connections 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- 172.21.15.12:0/2306644188 wait complete. 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 -- start start 2024-04-26T18:08:25.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.132+0000 7fe68a3dd740 1 Processor -- start 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e0de890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x55832e0e1690 con 0x55832e09d220 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x55832df9f030 con 0x55832e0dc4a0 2024-04-26T18:08:25.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x55832e0e1970 con 0x55832e0dbd90 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe68a3dd740 10 client.0 _ll_register_callbacks cb 0x55832e012c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41166/0 (socket says 172.21.15.12:41166) 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.133+0000 7fe685385640 1 -- 172.21.15.12:0/3427866721 learned_addr learned my addr 172.21.15.12:0/3427866721 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685b86640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e0de890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 -- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 msgr2=0x55832e0de890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e0de890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 -- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 msgr2=0x55832e0f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 -- 172.21.15.12:0/3427866721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832de441b0 con 0x55832e09d220 2024-04-26T18:08:25.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685b86640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e0de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe685385640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe67c059c50 tx=0x7fe67c020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305a3b982694b6d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:08:25.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c077060 con 0x55832e09d220 2024-04-26T18:08:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fe67c057fc0 con 0x55832e09d220 2024-04-26T18:08:25.152 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67c05e070 con 0x55832e09d220 2024-04-26T18:08:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe67c072040 con 0x55832e09d220 2024-04-26T18:08:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 10 client.5229 fetch_fsmap learned FSMap version 9 2024-04-26T18:08:25.153 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55832dcd7310 con 0x55832e09d220 2024-04-26T18:08:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe67c05e070 con 0x55832e09d220 2024-04-26T18:08:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe67c013070 con 0x55832e09d220 2024-04-26T18:08:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 10 client.5229 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:08:25.154 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 10 client.5229 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:08:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.134+0000 7fe68a3dd740 20 client.5229 populate_metadata read hostname 'smithi012' 2024-04-26T18:08:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0c6cb0 0x55832e0f6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe68a3dd740 4 client.5229 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-26T18:08:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55832e013880 con 0x55832e0c6cb0 2024-04-26T18:08:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0c6cb0 0x55832e0f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe65ffff640 10 client.5229 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:08:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.135+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0c6cb0 0x55832e0f6370 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=daa3599cca16af24 server_cookie=976f1f7aa33d716f in_seq=0 out_seq=0 2024-04-26T18:08:25.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427866721 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55832e013880 con 0x55832e0c6cb0 2024-04-26T18:08:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe65ffff640 10 client.5229 handle_command_reply: tid=0 2024-04-26T18:08:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 client.5229 shutdown 2024-04-26T18:08:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 msgr2=0x55832e0e4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe67c059c50 tx=0x7fe67c020070 comp rx=0 tx=0).stop 2024-04-26T18:08:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 shutdown_connections 2024-04-26T18:08:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e0de890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0c6cb0 0x55832e0f6370 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427866721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e0e4f10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 >> 172.21.15.12:0/3427866721 conn(0x55832e09ce40 msgr2=0x55832e0a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe65ffff640 0 client.5229 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:08:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 shutdown_connections 2024-04-26T18:08:25.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427866721 wait complete. 2024-04-26T18:08:25.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.136+0000 7fe68a3dd740 20 client.5229 trim_cache size 0 max 16384 2024-04-26T18:08:25.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.153+0000 7fe68a3dd740 1 Processor -- start 2024-04-26T18:08:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 -- start start 2024-04-26T18:08:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0da930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.171 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dbd90 0x55832e0e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe680200580 con 0x55832e0dc4a0 2024-04-26T18:08:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6801ff460 con 0x55832e0dbd90 2024-04-26T18:08:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe6800b06a0 con 0x55832e09d220 2024-04-26T18:08:25.172 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe685b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe685b86640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41174/0 (socket says 172.21.15.12:41174) 2024-04-26T18:08:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.154+0000 7fe685b86640 1 -- 172.21.15.12:0/1924190671 learned_addr learned my addr 172.21.15.12:0/1924190671 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 -- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 msgr2=0x55832e0da930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe684b84640 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dbd90 0x55832e0e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0da930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 -- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dbd90 msgr2=0x55832e0e5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dbd90 0x55832e0e5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 -- 172.21.15.12:0/1924190671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55832e0a3620 con 0x55832e0dc4a0 2024-04-26T18:08:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe685b86640 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6780012e0 tx=0x7fe678007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b36aec87940d5ad server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe66a7fc640 1 -- 172.21.15.12:0/1924190671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678019020 con 0x55832e0dc4a0 2024-04-26T18:08:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe66a7fc640 1 -- 172.21.15.12:0/1924190671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6780119b0 con 0x55832e0dc4a0 2024-04-26T18:08:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe66a7fc640 1 -- 172.21.15.12:0/1924190671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678011d80 con 0x55832e0dc4a0 2024-04-26T18:08:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 -- 172.21.15.12:0/1924190671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 msgr2=0x55832e0e6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe6780012e0 tx=0x7fe678007880 comp rx=0 tx=0).stop 2024-04-26T18:08:25.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 -- 172.21.15.12:0/1924190671 shutdown_connections 2024-04-26T18:08:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e0dc4a0 0x55832e0e6430 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dbd90 0x55832e0e5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/1924190671 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e09d220 0x55832e0da930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 -- 172.21.15.12:0/1924190671 >> 172.21.15.12:0/1924190671 conn(0x55832e09ce40 msgr2=0x55832e0a29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.155+0000 7fe68a3dd740 1 -- 172.21.15.12:0/1924190671 shutdown_connections 2024-04-26T18:08:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.156+0000 7fe68a3dd740 1 -- 172.21.15.12:0/1924190671 wait complete. 2024-04-26T18:08:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.156+0000 7fe68a3dd740 1 -- start start 2024-04-26T18:08:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.156+0000 7fe68a3dd740 1 Processor -- start 2024-04-26T18:08:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fe6801fe040 con 0x55832e09d220 2024-04-26T18:08:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fe6801fed90 con 0x55832e0dc4a0 2024-04-26T18:08:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fe6801fe6c0 con 0x55832e0dbd90 2024-04-26T18:08:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe68a3dd740 10 client.0 _ll_register_callbacks cb 0x7fe670035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-26T18:08:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41186/0 (socket says 172.21.15.12:41186) 2024-04-26T18:08:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 -- 172.21.15.12:0/3427483314 learned_addr learned my addr 172.21.15.12:0/3427483314 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685b86640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 -- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 msgr2=0x55832e15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 -- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 msgr2=0x55832e0ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 -- 172.21.15.12:0/3427483314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55832e09efb0 con 0x55832e09d220 2024-04-26T18:08:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685b86640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:25.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe685385640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007fd0 tx=0x7fe67c08a390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc4fa8083205ba4f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.157+0000 7fe65ffff640 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2024-04-26T18:08:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe67c05e070 con 0x55832e09d220 2024-04-26T18:08:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fe67c08c070 con 0x55832e09d220 2024-04-26T18:08:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6780119b0 con 0x55832e09d220 2024-04-26T18:08:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7fe67c059110 con 0x55832e09d220 2024-04-26T18:08:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 10 client.5235 fetch_fsmap learned FSMap version 9 2024-04-26T18:08:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55832e0c9460 con 0x55832e09d220 2024-04-26T18:08:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6780119b0 con 0x55832e09d220 2024-04-26T18:08:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7fe67c081020 con 0x55832e09d220 2024-04-26T18:08:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 10 client.5235 fetch_fsmap finished waiting for FSMap version 9 2024-04-26T18:08:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 10 client.5235 resolve_mds: validated gid 4300 aka daemon mds.b 2024-04-26T18:08:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 20 client.5235 populate_metadata read hostname 'smithi012' 2024-04-26T18:08:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0efdc0 0x55832e0f01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 4 client.5235 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-26T18:08:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 --> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55832e00d6f0 con 0x55832e0efdc0 2024-04-26T18:08:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.158+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0efdc0 0x55832e0f01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe684b84640 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0efdc0 0x55832e0f01a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb9d6b80a9879876 server_cookie=2c34d535d060f441 in_seq=0 out_seq=0 2024-04-26T18:08:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe65ffff640 10 client.5235 ms_handle_connect on v2:172.21.15.100:6838/3743641599 2024-04-26T18:08:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe65ffff640 1 -- 172.21.15.12:0/3427483314 <== mds.0 v2:172.21.15.100:6838/3743641599 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x55832e00d6f0 con 0x55832e0efdc0 2024-04-26T18:08:25.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe65ffff640 10 client.5235 handle_command_reply: tid=0 2024-04-26T18:08:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 client.5235 shutdown 2024-04-26T18:08:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 msgr2=0x55832e101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe67c007fd0 tx=0x7fe67c08a390 comp rx=0 tx=0).stop 2024-04-26T18:08:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 shutdown_connections 2024-04-26T18:08:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:6838/3743641599,v1:172.21.15.100:6839/3743641599] conn(0x55832e0efdc0 0x55832e0f01a0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55832e0dc4a0 0x55832e0ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55832e0dbd90 0x55832e15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe65ffff640 0 client.5235 ms_handle_reset on v2:172.21.15.100:6838/3743641599 2024-04-26T18:08:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 --2- 172.21.15.12:0/3427483314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55832e09d220 0x55832e101db0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 >> 172.21.15.12:0/3427483314 conn(0x55832e09ce40 msgr2=0x55832e0db430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 shutdown_connections 2024-04-26T18:08:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 1 -- 172.21.15.12:0/3427483314 wait complete. 2024-04-26T18:08:25.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.159+0000 7fe68a3dd740 20 client.5235 trim_cache size 0 max 16384 2024-04-26T18:08:25.194 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:25.194 INFO:teuthology.orchestra.run.smithi012.stdout: "epoch": 9, 2024-04-26T18:08:25.194 INFO:teuthology.orchestra.run.smithi012.stdout: "leader": 4300, 2024-04-26T18:08:25.195 INFO:teuthology.orchestra.run.smithi012.stdout: "set_version": 32, 2024-04-26T18:08:25.195 INFO:teuthology.orchestra.run.smithi012.stdout: "sets": {} 2024-04-26T18:08:25.195 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 msgr2=0x7fe66406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 0x7fe66406ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe670034000 tx=0x7fe67002e000 comp rx=0 tx=0).stop 2024-04-26T18:08:25.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 msgr2=0x7fe6800cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00d800 tx=0x7fe67c00dcc0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 shutdown_connections 2024-04-26T18:08:25.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fe66406c920 0x7fe66406ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe680155d30 0x7fe6800ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe6800c9df0 0x7fe6800cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 --2- 172.21.15.12:0/3401662270 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68006cd20 0x7fe6800cbac0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 >> 172.21.15.12:0/3401662270 conn(0x7fe680071e30 msgr2=0x7fe6800cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 shutdown_connections 2024-04-26T18:08:25.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.160+0000 7fe6875e9640 1 -- 172.21.15.12:0/3401662270 wait complete. 2024-04-26T18:08:25.204 INFO:tasks.quiescer:done joining Quiescers 2024-04-26T18:08:25.204 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-26T18:08:25.237 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-26T18:08:25.238 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T18:08:25.238 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:08:25.260 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2024-04-26T18:08:25.260 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-26T18:08:25.323 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-26T18:08:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.470+0000 7f4a3a43e640 1 Processor -- start 2024-04-26T18:08:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.470+0000 7f4a3a43e640 1 -- start start 2024-04-26T18:08:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a3a43e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a340ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a3a43e640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 0x7f4a340cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a3a43e640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a34156440 con 0x7f4a340cc600 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a3a43e640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4a340cd6e0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a3a43e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3415c8d0 con 0x7f4a34156060 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a389db640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4a340cc600 0x7f4a3415bcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46558/0 (socket says 172.21.15.12:46558) 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a389db640 1 -- 172.21.15.12:0/2178010550 learned_addr learned my addr 172.21.15.12:0/2178010550 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a33fff640 1 --2- 172.21.15.12:0/2178010550 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a340ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a337fe640 1 --2- 172.21.15.12:0/2178010550 >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 0x7f4a340cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658481882 0 0) 0x7f4a34156440 con 0x7f4a340cc600 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.471+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003520 con 0x7f4a340cc600 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a33fff640 1 -- 172.21.15.12:0/2178010550 >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 msgr2=0x7f4a340cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a33fff640 1 --2- 172.21.15.12:0/2178010550 >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 0x7f4a340cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a33fff640 1 -- 172.21.15.12:0/2178010550 >> v1:172.21.15.12:6789/0 conn(0x7f4a340cc600 legacy=0x7f4a3415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1731592541 0 0) 0x7f4a20003520 con 0x7f4a340cc600 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a33fff640 1 -- 172.21.15.12:0/2178010550 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a340cd980 con 0x7f4a34156060 2024-04-26T18:08:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a337fe640 1 --2- 172.21.15.12:0/2178010550 >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 0x7f4a340cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:25.476 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.472+0000 7f4a33fff640 1 --2- 172.21.15.12:0/2178010550 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a340ce460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a240097a0 tx=0x7f4a2402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc8472c20505e4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24037070 con 0x7f4a34156060 2024-04-26T18:08:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2402ac30 con 0x7f4a34156060 2024-04-26T18:08:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a32ffd640 1 -- 172.21.15.12:0/2178010550 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0019f0 con 0x7f4a34156060 2024-04-26T18:08:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 -- 172.21.15.12:0/2178010550 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 msgr2=0x7f4a340ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/2178010550 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a340ce460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a240097a0 tx=0x7f4a2402a1a0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 -- 172.21.15.12:0/2178010550 shutdown_connections 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/2178010550 >> v2:172.21.15.100:3300/0 conn(0x7f4a340cd0f0 0x7f4a340cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/2178010550 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a340ce460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 -- 172.21.15.12:0/2178010550 >> 172.21.15.12:0/2178010550 conn(0x7f4a34074310 msgr2=0x7f4a34068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 -- 172.21.15.12:0/2178010550 shutdown_connections 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.473+0000 7f4a3a43e640 1 -- 172.21.15.12:0/2178010550 wait complete. 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 Processor -- start 2024-04-26T18:08:25.480 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 -- start start 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a340cc600 0x7f4a34157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a34158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3415cbb0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4a340cdf40 con 0x7f4a340cc600 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a3a43e640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4a340c68d0 con 0x7f4a34156060 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.475+0000 7f4a337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.481 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41188/0 (socket says 172.21.15.12:41188) 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 -- 172.21.15.12:0/236471375 learned_addr learned my addr 172.21.15.12:0/236471375 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a389db640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a34158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a33fff640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a340cc600 0x7f4a34157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 -- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 msgr2=0x7f4a34158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a34158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 -- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a340cc600 msgr2=0x7f4a34157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a340cc600 0x7f4a34157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 -- 172.21.15.12:0/236471375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a34158000 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a337fe640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ebe0 tx=0x7f4a1c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c017070 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c00cbd0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a340cf3c0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c013470 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.476+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a340cf980 con 0x7f4a340cd0f0 2024-04-26T18:08:25.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.477+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a34076d20 con 0x7f4a340cd0f0 2024-04-26T18:08:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.478+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a1c01a070 con 0x7f4a340cd0f0 2024-04-26T18:08:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.478+0000 7f4a30ff9640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 0x7f4a1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.478+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4a1c08c090 con 0x7f4a340cd0f0 2024-04-26T18:08:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.478+0000 7f4a33fff640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 0x7f4a1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:25.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.479+0000 7f4a33fff640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 0x7f4a1406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:25.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.482+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a1c059ac0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.684+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a340ccc00 con 0x7f4a340cd0f0 2024-04-26T18:08:25.685 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.684+0000 7f4a30ff9640 1 -- 172.21.15.12:0/236471375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7f4a1c05ddc0 con 0x7f4a340cd0f0 2024-04-26T18:08:25.685 INFO:teuthology.orchestra.run.smithi012.stderr:listed 0 entries 2024-04-26T18:08:25.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.686+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 msgr2=0x7f4a1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.686+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 0x7f4a1406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402e000 comp rx=0 tx=0).stop 2024-04-26T18:08:25.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 msgr2=0x7f4a340d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ebe0 tx=0x7f4a1c00c520 comp rx=0 tx=0).stop 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 shutdown_connections 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4a1406c920 0x7f4a1406ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4a34156060 0x7f4a34158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a340cd0f0 0x7f4a340d15a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 --2- 172.21.15.12:0/236471375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4a340cc600 0x7f4a34157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:25.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 >> 172.21.15.12:0/236471375 conn(0x7f4a34074310 msgr2=0x7f4a340b4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:25.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 shutdown_connections 2024-04-26T18:08:25.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:25.687+0000 7f4a3a43e640 1 -- 172.21.15.12:0/236471375 wait complete. 2024-04-26T18:08:25.698 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-26T18:08:25.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:08:25.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-26T18:08:28.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:08:28.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:08:28.991 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-26T18:08:29.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:08:29.010 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2024-04-26T18:08:29.069 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-26T18:08:29.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:08:29.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-26T18:08:29.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-26T18:08:29.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2024-04-26T18:08:29.235 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T18:08:29.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T18:08:29.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:08:29.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.353+0000 7f3335ae3640 1 Processor -- start 2024-04-26T18:08:29.354 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.354+0000 7f3335ae3640 1 -- start start 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.354+0000 7f3335ae3640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3330152cb0 0x7f333015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.354+0000 7f3335ae3640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33300736a0 con 0x7f33300c7c20 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.354+0000 7f3335ae3640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33300c62e0 con 0x7f33300c89f0 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.354+0000 7f3335ae3640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f3330073940 con 0x7f3330152cb0 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332f7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3330152cb0 0x7f333015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.356 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f33300c7c20 0x7f33301630e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46568/0 (socket says 172.21.15.12:46568) 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332ffff640 1 -- 172.21.15.12:0/2918829816 learned_addr learned my addr 172.21.15.12:0/2918829816 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332f7fe640 1 -- 172.21.15.12:0/2918829816 >> v1:172.21.15.100:6789/0 conn(0x7f33300c89f0 legacy=0x7f33300cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332f7fe640 1 -- 172.21.15.12:0/2918829816 >> v1:172.21.15.12:6789/0 conn(0x7f33300c7c20 legacy=0x7f33301630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332f7fe640 1 -- 172.21.15.12:0/2918829816 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33300c48c0 con 0x7f3330152cb0 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.355+0000 7f332e7fc640 1 -- 172.21.15.12:0/2918829816 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365678064 0 0) 0x7f33300736a0 con 0x7f33300c7c20 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f332f7fe640 1 --2- 172.21.15.12:0/2918829816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f333015bd50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f33200097a0 tx=0x7f332002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e4333ec232769c server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f332e7fc640 1 -- 172.21.15.12:0/2918829816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320037070 con 0x7f3330152cb0 2024-04-26T18:08:29.357 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f332e7fc640 1 -- 172.21.15.12:0/2918829816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3320032440 con 0x7f3330152cb0 2024-04-26T18:08:29.358 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f332e7fc640 1 -- 172.21.15.12:0/2918829816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3320032810 con 0x7f3330152cb0 2024-04-26T18:08:29.360 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 -- 172.21.15.12:0/2918829816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 msgr2=0x7f333015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 --2- 172.21.15.12:0/2918829816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f333015bd50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f33200097a0 tx=0x7f332002a270 comp rx=0 tx=0).stop 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 -- 172.21.15.12:0/2918829816 shutdown_connections 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 --2- 172.21.15.12:0/2918829816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f333015bd50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 -- 172.21.15.12:0/2918829816 >> 172.21.15.12:0/2918829816 conn(0x7f3330068270 msgr2=0x7f3330068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 -- 172.21.15.12:0/2918829816 shutdown_connections 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.356+0000 7f3335ae3640 1 -- 172.21.15.12:0/2918829816 wait complete. 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.358+0000 7f3335ae3640 1 Processor -- start 2024-04-26T18:08:29.361 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.358+0000 7f3335ae3640 1 -- start start 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.358+0000 7f3335ae3640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33300c7c20 0x7f33301e5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.358+0000 7f3335ae3640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f33300c89f0 0x7f3330157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.358+0000 7f3335ae3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3335ae3640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f33300c4d20 con 0x7f3330152cb0 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3335ae3640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f33300c4ba0 con 0x7f33300c7c20 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3335ae3640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f33300cdb70 con 0x7f33300c89f0 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41194/0 (socket says 172.21.15.12:41194) 2024-04-26T18:08:29.362 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 -- 172.21.15.12:0/562452380 learned_addr learned my addr 172.21.15.12:0/562452380 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332f7fe640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33300c7c20 0x7f33301e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332effd640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f33300c89f0 0x7f3330157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 -- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f33300c89f0 msgr2=0x7f3330157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f33300c89f0 0x7f3330157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 -- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33300c7c20 msgr2=0x7f33301e5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33300c7c20 0x7f33301e5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 -- 172.21.15.12:0/562452380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33301e2ac0 con 0x7f3330152cb0 2024-04-26T18:08:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f332ffff640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f332800c7a0 tx=0x7f332800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3328018070 con 0x7f3330152cb0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332800a640 con 0x7f3330152cb0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33301f5f10 con 0x7f3330152cb0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332800aab0 con 0x7f3330152cb0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.359+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33301e2580 con 0x7f3330152cb0 2024-04-26T18:08:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.361+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3330076d20 con 0x7f3330152cb0 2024-04-26T18:08:29.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.361+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f332801b070 con 0x7f3330152cb0 2024-04-26T18:08:29.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.361+0000 7f3317fff640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 0x7f331c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.361+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f332808b510 con 0x7f3330152cb0 2024-04-26T18:08:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.362+0000 7f332f7fe640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 0x7f331c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.362+0000 7f332f7fe640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 0x7f331c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3320034000 tx=0x7f332002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.366+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3328058eb0 con 0x7f3330152cb0 2024-04-26T18:08:29.551 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.551+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33301e28a0 con 0x7f331c06c8f0 2024-04-26T18:08:29.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.564+0000 7f3317fff640 1 -- 172.21.15.12:0/562452380 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336588 (secure 0 0 0) 0x7f33301e28a0 con 0x7f331c06c8f0 2024-04-26T18:08:29.568 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:29.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 msgr2=0x7f331c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 0x7f331c06edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3320034000 tx=0x7f332002e000 comp rx=0 tx=0).stop 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 msgr2=0x7f3330157760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f332800c7a0 tx=0x7f332800cc60 comp rx=0 tx=0).stop 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 shutdown_connections 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3330152cb0 0x7f3330157760 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.572 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f331c06c8f0 0x7f331c06edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f33300c89f0 0x7f3330157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 --2- 172.21.15.12:0/562452380 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33300c7c20 0x7f33301e5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 >> 172.21.15.12:0/562452380 conn(0x7f3330068270 msgr2=0x7f33300cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:29.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 shutdown_connections 2024-04-26T18:08:29.573 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.567+0000 7f3335ae3640 1 -- 172.21.15.12:0/562452380 wait complete. 2024-04-26T18:08:29.579 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-04-26T18:08:28.033657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1177407960,"num_objects":10787,"num_object_clones":0,"num_object_copies":42846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10787,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30231,"num_write_kb":1777170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35133,"ondisk_log_size":35133,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3184164,"kb_used_data":2387876,"kb_used_omap":12,"kb_used_meta":796211,"kb_avail":751790556,"statfs":{"total":773094113280,"available":769833529344,"internally_reserved":0,"allocated":2445185024,"data_stored":2443421490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":815320624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69348736,"num_objects":2504,"num_object_clones":0,"num_object_copies":9938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2504,"num_whiteouts":0,"num_read":10,"num_read_kb":24528,"num_write":2736,"num_write_kb":69936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"2.1f","version":"36'123","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655962+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T18:06:59.655962+0000","last_peered":"2024-04-26T18:06:59.655962+0000","last_clean":"2024-04-26T18:06:59.655962+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:06:59.655962+0000","last_undegraded":"2024-04-26T18:06:59.655962+0000","last_fullsized":"2024-04-26T18:06:59.655962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'87","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.943078+0000","last_change":"2024-04-26T18:03:24.967895+0000","last_active":"2024-04-26T18:06:16.943078+0000","last_peered":"2024-04-26T18:06:16.943078+0000","last_clean":"2024-04-26T18:06:16.943078+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:06:16.943078+0000","last_undegraded":"2024-04-26T18:06:16.943078+0000","last_fullsized":"2024-04-26T18:06:16.943078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:40.112811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.700846+0000","last_change":"2024-04-26T18:03:24.991152+0000","last_active":"2024-04-26T18:08:26.700846+0000","last_peered":"2024-04-26T18:08:26.700846+0000","last_clean":"2024-04-26T18:08:26.700846+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:26.700846+0000","last_undegraded":"2024-04-26T18:08:26.700846+0000","last_fullsized":"2024-04-26T18:08:26.700846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:03.026992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1624","reported_seq":1675,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.655650+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T18:08:19.655650+0000","last_peered":"2024-04-26T18:08:19.655650+0000","last_clean":"2024-04-26T18:08:19.655650+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:19.655650+0000","last_undegraded":"2024-04-26T18:08:19.655650+0000","last_fullsized":"2024-04-26T18:08:19.655650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930816+0000","last_change":"2024-04-26T18:03:25.006390+0000","last_active":"2024-04-26T18:04:31.930816+0000","last_peered":"2024-04-26T18:04:31.930816+0000","last_clean":"2024-04-26T18:04:31.930816+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:04:31.930816+0000","last_undegraded":"2024-04-26T18:04:31.930816+0000","last_fullsized":"2024-04-26T18:04:31.930816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:42.430689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2789,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678592+0000","last_change":"2024-04-26T18:03:24.654455+0000","last_active":"2024-04-26T18:08:26.678592+0000","last_peered":"2024-04-26T18:08:26.678592+0000","last_clean":"2024-04-26T18:08:26.678592+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:26.678592+0000","last_undegraded":"2024-04-26T18:08:26.678592+0000","last_fullsized":"2024-04-26T18:08:26.678592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.834932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'722","reported_seq":772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372121+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T18:08:14.372121+0000","last_peered":"2024-04-26T18:08:14.372121+0000","last_clean":"2024-04-26T18:08:14.372121+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:14.372121+0000","last_undegraded":"2024-04-26T18:08:14.372121+0000","last_fullsized":"2024-04-26T18:08:14.372121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'82","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938591+0000","last_change":"2024-04-26T18:03:24.642146+0000","last_active":"2024-04-26T18:05:46.938591+0000","last_peered":"2024-04-26T18:05:46.938591+0000","last_clean":"2024-04-26T18:05:46.938591+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:05:46.938591+0000","last_undegraded":"2024-04-26T18:05:46.938591+0000","last_fullsized":"2024-04-26T18:05:46.938591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:42.065227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678605+0000","last_change":"2024-04-26T18:03:24.657679+0000","last_active":"2024-04-26T18:08:26.678605+0000","last_peered":"2024-04-26T18:08:26.678605+0000","last_clean":"2024-04-26T18:08:26.678605+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:26.678605+0000","last_undegraded":"2024-04-26T18:08:26.678605+0000","last_fullsized":"2024-04-26T18:08:26.678605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:45.442811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'165","reported_seq":215,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.603071+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T18:08:19.603071+0000","last_peered":"2024-04-26T18:08:19.603071+0000","last_clean":"2024-04-26T18:08:19.603071+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:19.603071+0000","last_undegraded":"2024-04-26T18:08:19.603071+0000","last_fullsized":"2024-04-26T18:08:19.603071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'75","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:38.915794+0000","last_change":"2024-04-26T18:03:24.641061+0000","last_active":"2024-04-26T18:06:38.915794+0000","last_peered":"2024-04-26T18:06:38.915794+0000","last_clean":"2024-04-26T18:06:38.915794+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:06:38.915794+0000","last_undegraded":"2024-04-26T18:06:38.915794+0000","last_fullsized":"2024-04-26T18:06:38.915794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:45.214146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494273+0000","last_change":"2024-04-26T18:03:24.655979+0000","last_active":"2024-04-26T18:08:26.494273+0000","last_peered":"2024-04-26T18:08:26.494273+0000","last_clean":"2024-04-26T18:08:26.494273+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:26.494273+0000","last_undegraded":"2024-04-26T18:08:26.494273+0000","last_fullsized":"2024-04-26T18:08:26.494273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:20.235120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931210+0000","last_change":"2024-04-26T18:03:24.635966+0000","last_active":"2024-04-26T18:04:46.931210+0000","last_peered":"2024-04-26T18:04:46.931210+0000","last_clean":"2024-04-26T18:04:46.931210+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:04:46.931210+0000","last_undegraded":"2024-04-26T18:04:46.931210+0000","last_fullsized":"2024-04-26T18:04:46.931210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:08.113204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'224","reported_seq":274,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655859+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T18:06:59.655859+0000","last_peered":"2024-04-26T18:06:59.655859+0000","last_clean":"2024-04-26T18:06:59.655859+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:06:59.655859+0000","last_undegraded":"2024-04-26T18:06:59.655859+0000","last_fullsized":"2024-04-26T18:06:59.655859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656882+0000","last_change":"2024-04-26T18:03:24.657047+0000","last_active":"2024-04-26T18:08:26.656882+0000","last_peered":"2024-04-26T18:08:26.656882+0000","last_clean":"2024-04-26T18:08:26.656882+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:26.656882+0000","last_undegraded":"2024-04-26T18:08:26.656882+0000","last_fullsized":"2024-04-26T18:08:26.656882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:12.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934167+0000","last_change":"2024-04-26T18:03:24.972452+0000","last_active":"2024-04-26T18:05:01.934167+0000","last_peered":"2024-04-26T18:05:01.934167+0000","last_clean":"2024-04-26T18:05:01.934167+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:05:01.934167+0000","last_undegraded":"2024-04-26T18:05:01.934167+0000","last_fullsized":"2024-04-26T18:05:01.934167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:22.285266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'837","reported_seq":887,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:14.564924+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T18:07:14.564924+0000","last_peered":"2024-04-26T18:07:14.564924+0000","last_clean":"2024-04-26T18:07:14.564924+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:07:14.564924+0000","last_undegraded":"2024-04-26T18:07:14.564924+0000","last_fullsized":"2024-04-26T18:07:14.564924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":8790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.491409+0000","last_change":"2024-04-26T18:03:24.656810+0000","last_active":"2024-04-26T18:08:26.491409+0000","last_peered":"2024-04-26T18:08:26.491409+0000","last_clean":"2024-04-26T18:08:26.491409+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:26.491409+0000","last_undegraded":"2024-04-26T18:08:26.491409+0000","last_fullsized":"2024-04-26T18:08:26.491409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:58.022914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905447+0000","last_change":"2024-04-26T18:03:24.996978+0000","last_active":"2024-04-26T18:06:10.905447+0000","last_peered":"2024-04-26T18:06:10.905447+0000","last_clean":"2024-04-26T18:06:10.905447+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:06:10.905447+0000","last_undegraded":"2024-04-26T18:06:10.905447+0000","last_fullsized":"2024-04-26T18:06:10.905447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.166776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'70","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372832+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T18:08:14.372832+0000","last_peered":"2024-04-26T18:08:14.372832+0000","last_clean":"2024-04-26T18:08:14.372832+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:14.372832+0000","last_undegraded":"2024-04-26T18:08:14.372832+0000","last_fullsized":"2024-04-26T18:08:14.372832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2794,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640445+0000","last_change":"2024-04-26T18:03:24.748206+0000","last_active":"2024-04-26T18:08:26.640445+0000","last_peered":"2024-04-26T18:08:26.640445+0000","last_clean":"2024-04-26T18:08:26.640445+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:26.640445+0000","last_undegraded":"2024-04-26T18:08:26.640445+0000","last_fullsized":"2024-04-26T18:08:26.640445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:03.632839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'91","reported_seq":2160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.937288+0000","last_change":"2024-04-26T18:03:24.656039+0000","last_active":"2024-04-26T18:04:46.937288+0000","last_peered":"2024-04-26T18:04:46.937288+0000","last_clean":"2024-04-26T18:04:46.937288+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:04:46.937288+0000","last_undegraded":"2024-04-26T18:04:46.937288+0000","last_fullsized":"2024-04-26T18:04:46.937288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:46.594712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'7","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.755314+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T18:06:59.755314+0000","last_peered":"2024-04-26T18:06:59.755314+0000","last_clean":"2024-04-26T18:06:59.755314+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:06:59.755314+0000","last_undegraded":"2024-04-26T18:06:59.755314+0000","last_fullsized":"2024-04-26T18:06:59.755314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.473190+0000","last_change":"2024-04-26T18:03:24.656487+0000","last_active":"2024-04-26T18:08:26.473190+0000","last_peered":"2024-04-26T18:08:26.473190+0000","last_clean":"2024-04-26T18:08:26.473190+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:26.473190+0000","last_undegraded":"2024-04-26T18:08:26.473190+0000","last_fullsized":"2024-04-26T18:08:26.473190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:09.597061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932205+0000","last_change":"2024-04-26T18:03:25.006124+0000","last_active":"2024-04-26T18:04:46.932205+0000","last_peered":"2024-04-26T18:04:46.932205+0000","last_clean":"2024-04-26T18:04:46.932205+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:04:46.932205+0000","last_undegraded":"2024-04-26T18:04:46.932205+0000","last_fullsized":"2024-04-26T18:04:46.932205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:50.782589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'192","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:41.930694+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T18:04:41.930694+0000","last_peered":"2024-04-26T18:04:41.930694+0000","last_clean":"2024-04-26T18:04:41.930694+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:04:41.930694+0000","last_undegraded":"2024-04-26T18:04:41.930694+0000","last_fullsized":"2024-04-26T18:04:41.930694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2799,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.633174+0000","last_change":"2024-04-26T18:03:24.655017+0000","last_active":"2024-04-26T18:08:26.633174+0000","last_peered":"2024-04-26T18:08:26.633174+0000","last_clean":"2024-04-26T18:08:26.633174+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:26.633174+0000","last_undegraded":"2024-04-26T18:08:26.633174+0000","last_fullsized":"2024-04-26T18:08:26.633174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:34.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'83","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:26.937150+0000","last_change":"2024-04-26T18:03:24.746543+0000","last_active":"2024-04-26T18:05:26.937150+0000","last_peered":"2024-04-26T18:05:26.937150+0000","last_clean":"2024-04-26T18:05:26.937150+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:05:26.937150+0000","last_undegraded":"2024-04-26T18:05:26.937150+0000","last_fullsized":"2024-04-26T18:05:26.937150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:51.534255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'258","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.976486+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T18:08:23.976486+0000","last_peered":"2024-04-26T18:08:23.976486+0000","last_clean":"2024-04-26T18:08:23.976486+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:23.976486+0000","last_undegraded":"2024-04-26T18:08:23.976486+0000","last_fullsized":"2024-04-26T18:08:23.976486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2829,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.689970+0000","last_change":"2024-04-26T18:03:24.996787+0000","last_active":"2024-04-26T18:08:26.689970+0000","last_peered":"2024-04-26T18:08:26.689970+0000","last_clean":"2024-04-26T18:08:26.689970+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:26.689970+0000","last_undegraded":"2024-04-26T18:08:26.689970+0000","last_fullsized":"2024-04-26T18:08:26.689970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930926+0000","last_change":"2024-04-26T18:03:24.747226+0000","last_active":"2024-04-26T18:04:31.930926+0000","last_peered":"2024-04-26T18:04:31.930926+0000","last_clean":"2024-04-26T18:04:31.930926+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:04:31.930926+0000","last_undegraded":"2024-04-26T18:04:31.930926+0000","last_fullsized":"2024-04-26T18:04:31.930926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.708780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'145","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.147385+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T18:06:37.147385+0000","last_peered":"2024-04-26T18:06:37.147385+0000","last_clean":"2024-04-26T18:06:37.147385+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:06:37.147385+0000","last_undegraded":"2024-04-26T18:06:37.147385+0000","last_fullsized":"2024-04-26T18:06:37.147385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.331133+0000","last_change":"2024-04-26T18:03:25.011835+0000","last_active":"2024-04-26T18:08:26.331133+0000","last_peered":"2024-04-26T18:08:26.331133+0000","last_clean":"2024-04-26T18:08:26.331133+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:26.331133+0000","last_undegraded":"2024-04-26T18:08:26.331133+0000","last_fullsized":"2024-04-26T18:08:26.331133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.743889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'79","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929493+0000","last_change":"2024-04-26T18:03:24.641851+0000","last_active":"2024-04-26T18:04:31.929493+0000","last_peered":"2024-04-26T18:04:31.929493+0000","last_clean":"2024-04-26T18:04:31.929493+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:04:31.929493+0000","last_undegraded":"2024-04-26T18:04:31.929493+0000","last_fullsized":"2024-04-26T18:04:31.929493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:05.076764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'132","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602929+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T18:08:19.602929+0000","last_peered":"2024-04-26T18:08:19.602929+0000","last_clean":"2024-04-26T18:08:19.602929+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:19.602929+0000","last_undegraded":"2024-04-26T18:08:19.602929+0000","last_fullsized":"2024-04-26T18:08:19.602929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.532024+0000","last_change":"2024-04-26T18:03:24.748734+0000","last_active":"2024-04-26T18:08:26.532024+0000","last_peered":"2024-04-26T18:08:26.532024+0000","last_clean":"2024-04-26T18:08:26.532024+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:26.532024+0000","last_undegraded":"2024-04-26T18:08:26.532024+0000","last_fullsized":"2024-04-26T18:08:26.532024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:50.548538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'89","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.871972+0000","last_change":"2024-04-26T18:03:24.657308+0000","last_active":"2024-04-26T18:05:06.871972+0000","last_peered":"2024-04-26T18:05:06.871972+0000","last_clean":"2024-04-26T18:05:06.871972+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:05:06.871972+0000","last_undegraded":"2024-04-26T18:05:06.871972+0000","last_fullsized":"2024-04-26T18:05:06.871972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:50.688884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.654871+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T18:06:59.654871+0000","last_peered":"2024-04-26T18:06:59.654871+0000","last_clean":"2024-04-26T18:06:59.654871+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:06:59.654871+0000","last_undegraded":"2024-04-26T18:06:59.654871+0000","last_fullsized":"2024-04-26T18:06:59.654871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2738,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.524101+0000","last_change":"2024-04-26T18:03:24.747715+0000","last_active":"2024-04-26T18:08:26.524101+0000","last_peered":"2024-04-26T18:08:26.524101+0000","last_clean":"2024-04-26T18:08:26.524101+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:26.524101+0000","last_undegraded":"2024-04-26T18:08:26.524101+0000","last_fullsized":"2024-04-26T18:08:26.524101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:59.495568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"34'75","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941608+0000","last_change":"2024-04-26T18:03:24.749179+0000","last_active":"2024-04-26T18:06:16.941608+0000","last_peered":"2024-04-26T18:06:16.941608+0000","last_clean":"2024-04-26T18:06:16.941608+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:06:16.941608+0000","last_undegraded":"2024-04-26T18:06:16.941608+0000","last_fullsized":"2024-04-26T18:06:16.941608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:10.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'124","reported_seq":294,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.718532+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T18:06:45.718532+0000","last_peered":"2024-04-26T18:06:45.718532+0000","last_clean":"2024-04-26T18:06:45.718532+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:06:45.718532+0000","last_undegraded":"2024-04-26T18:06:45.718532+0000","last_fullsized":"2024-04-26T18:06:45.718532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2744,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640670+0000","last_change":"2024-04-26T18:03:24.748508+0000","last_active":"2024-04-26T18:08:26.640670+0000","last_peered":"2024-04-26T18:08:26.640670+0000","last_clean":"2024-04-26T18:08:26.640670+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:26.640670+0000","last_undegraded":"2024-04-26T18:08:26.640670+0000","last_fullsized":"2024-04-26T18:08:26.640670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:08:50.836401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"35'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930743+0000","last_change":"2024-04-26T18:03:25.001751+0000","last_active":"2024-04-26T18:04:31.930743+0000","last_peered":"2024-04-26T18:04:31.930743+0000","last_clean":"2024-04-26T18:04:31.930743+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:04:31.930743+0000","last_undegraded":"2024-04-26T18:04:31.930743+0000","last_fullsized":"2024-04-26T18:04:31.930743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'250","reported_seq":301,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:11.941507+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T18:06:11.941507+0000","last_peered":"2024-04-26T18:06:11.941507+0000","last_clean":"2024-04-26T18:06:11.941507+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:06:11.941507+0000","last_undegraded":"2024-04-26T18:06:11.941507+0000","last_fullsized":"2024-04-26T18:06:11.941507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494713+0000","last_change":"2024-04-26T18:03:25.005985+0000","last_active":"2024-04-26T18:08:26.494713+0000","last_peered":"2024-04-26T18:08:26.494713+0000","last_clean":"2024-04-26T18:08:26.494713+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:26.494713+0000","last_undegraded":"2024-04-26T18:08:26.494713+0000","last_fullsized":"2024-04-26T18:08:26.494713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:46.423765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.880149+0000","last_change":"2024-04-26T18:03:24.984011+0000","last_active":"2024-04-26T18:05:06.880149+0000","last_peered":"2024-04-26T18:05:06.880149+0000","last_clean":"2024-04-26T18:05:06.880149+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:05:06.880149+0000","last_undegraded":"2024-04-26T18:05:06.880149+0000","last_fullsized":"2024-04-26T18:05:06.880149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:09.171009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'113","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:31.943358+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T18:06:31.943358+0000","last_peered":"2024-04-26T18:06:31.943358+0000","last_clean":"2024-04-26T18:06:31.943358+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:06:31.943358+0000","last_undegraded":"2024-04-26T18:06:31.943358+0000","last_fullsized":"2024-04-26T18:06:31.943358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:06.941024+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T18:06:06.941024+0000","last_peered":"2024-04-26T18:06:06.941024+0000","last_clean":"2024-04-26T18:06:06.941024+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:06:06.941024+0000","last_undegraded":"2024-04-26T18:06:06.941024+0000","last_fullsized":"2024-04-26T18:06:06.941024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.315128+0000","last_change":"2024-04-26T18:03:24.635471+0000","last_active":"2024-04-26T18:08:26.315128+0000","last_peered":"2024-04-26T18:08:26.315128+0000","last_clean":"2024-04-26T18:08:26.315128+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:26.315128+0000","last_undegraded":"2024-04-26T18:08:26.315128+0000","last_fullsized":"2024-04-26T18:08:26.315128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:03.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933106+0000","last_change":"2024-04-26T18:03:24.944311+0000","last_active":"2024-04-26T18:05:01.933106+0000","last_peered":"2024-04-26T18:05:01.933106+0000","last_clean":"2024-04-26T18:05:01.933106+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:05:01.933106+0000","last_undegraded":"2024-04-26T18:05:01.933106+0000","last_fullsized":"2024-04-26T18:05:01.933106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:11.446948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'339","reported_seq":389,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.895454+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T18:08:18.895454+0000","last_peered":"2024-04-26T18:08:18.895454+0000","last_clean":"2024-04-26T18:08:18.895454+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:18.895454+0000","last_undegraded":"2024-04-26T18:08:18.895454+0000","last_fullsized":"2024-04-26T18:08:18.895454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2790,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.275515+0000","last_change":"2024-04-26T18:03:24.636889+0000","last_active":"2024-04-26T18:08:26.275515+0000","last_peered":"2024-04-26T18:08:26.275515+0000","last_clean":"2024-04-26T18:08:26.275515+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:26.275515+0000","last_undegraded":"2024-04-26T18:08:26.275515+0000","last_fullsized":"2024-04-26T18:08:26.275515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:57.257654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'90","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933112+0000","last_change":"2024-04-26T18:03:24.642373+0000","last_active":"2024-04-26T18:05:01.933112+0000","last_peered":"2024-04-26T18:05:01.933112+0000","last_clean":"2024-04-26T18:05:01.933112+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:05:01.933112+0000","last_undegraded":"2024-04-26T18:05:01.933112+0000","last_fullsized":"2024-04-26T18:05:01.933112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:50.494058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'11","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.319192+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T18:08:23.319192+0000","last_peered":"2024-04-26T18:08:23.319192+0000","last_clean":"2024-04-26T18:08:23.319192+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:23.319192+0000","last_undegraded":"2024-04-26T18:08:23.319192+0000","last_fullsized":"2024-04-26T18:08:23.319192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.339174+0000","last_change":"2024-04-26T18:03:25.011325+0000","last_active":"2024-04-26T18:08:26.339174+0000","last_peered":"2024-04-26T18:08:26.339174+0000","last_clean":"2024-04-26T18:08:26.339174+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:26.339174+0000","last_undegraded":"2024-04-26T18:08:26.339174+0000","last_fullsized":"2024-04-26T18:08:26.339174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:28.586899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933183+0000","last_change":"2024-04-26T18:03:24.946369+0000","last_active":"2024-04-26T18:05:01.933183+0000","last_peered":"2024-04-26T18:05:01.933183+0000","last_clean":"2024-04-26T18:05:01.933183+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:05:01.933183+0000","last_undegraded":"2024-04-26T18:05:01.933183+0000","last_fullsized":"2024-04-26T18:05:01.933183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.852091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'114","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.484515+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T18:08:18.484515+0000","last_peered":"2024-04-26T18:08:18.484515+0000","last_clean":"2024-04-26T18:08:18.484515+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:18.484515+0000","last_undegraded":"2024-04-26T18:08:18.484515+0000","last_fullsized":"2024-04-26T18:08:18.484515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.245217+0000","last_change":"2024-04-26T18:03:24.635236+0000","last_active":"2024-04-26T18:08:26.245217+0000","last_peered":"2024-04-26T18:08:26.245217+0000","last_clean":"2024-04-26T18:08:26.245217+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:26.245217+0000","last_undegraded":"2024-04-26T18:08:26.245217+0000","last_fullsized":"2024-04-26T18:08:26.245217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:48.980355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'61","reported_seq":2130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933163+0000","last_change":"2024-04-26T18:03:24.944998+0000","last_active":"2024-04-26T18:05:01.933163+0000","last_peered":"2024-04-26T18:05:01.933163+0000","last_clean":"2024-04-26T18:05:01.933163+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:05:01.933163+0000","last_undegraded":"2024-04-26T18:05:01.933163+0000","last_fullsized":"2024-04-26T18:05:01.933163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:30.416363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'61","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.756283+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T18:06:59.756283+0000","last_peered":"2024-04-26T18:06:59.756283+0000","last_clean":"2024-04-26T18:06:59.756283+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:06:59.756283+0000","last_undegraded":"2024-04-26T18:06:59.756283+0000","last_fullsized":"2024-04-26T18:06:59.756283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2819,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.652003+0000","last_change":"2024-04-26T18:03:24.655394+0000","last_active":"2024-04-26T18:08:26.652003+0000","last_peered":"2024-04-26T18:08:26.652003+0000","last_clean":"2024-04-26T18:08:26.652003+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:26.652003+0000","last_undegraded":"2024-04-26T18:08:26.652003+0000","last_fullsized":"2024-04-26T18:08:26.652003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:04.461317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934805+0000","last_change":"2024-04-26T18:03:24.943633+0000","last_active":"2024-04-26T18:05:16.934805+0000","last_peered":"2024-04-26T18:05:16.934805+0000","last_clean":"2024-04-26T18:05:16.934805+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:05:16.934805+0000","last_undegraded":"2024-04-26T18:05:16.934805+0000","last_fullsized":"2024-04-26T18:05:16.934805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:39.290525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949117+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T18:07:31.949117+0000","last_peered":"2024-04-26T18:07:31.949117+0000","last_clean":"2024-04-26T18:07:31.949117+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:07:31.949117+0000","last_undegraded":"2024-04-26T18:07:31.949117+0000","last_fullsized":"2024-04-26T18:07:31.949117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2765,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.500056+0000","last_change":"2024-04-26T18:03:25.006200+0000","last_active":"2024-04-26T18:08:26.500056+0000","last_peered":"2024-04-26T18:08:26.500056+0000","last_clean":"2024-04-26T18:08:26.500056+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:26.500056+0000","last_undegraded":"2024-04-26T18:08:26.500056+0000","last_fullsized":"2024-04-26T18:08:26.500056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:04.984283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903544+0000","last_change":"2024-04-26T18:03:24.636576+0000","last_active":"2024-04-26T18:06:10.903544+0000","last_peered":"2024-04-26T18:06:10.903544+0000","last_clean":"2024-04-26T18:06:10.903544+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:06:10.903544+0000","last_undegraded":"2024-04-26T18:06:10.903544+0000","last_fullsized":"2024-04-26T18:06:10.903544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:01.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949842+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T18:07:31.949842+0000","last_peered":"2024-04-26T18:07:31.949842+0000","last_clean":"2024-04-26T18:07:31.949842+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:07:31.949842+0000","last_undegraded":"2024-04-26T18:07:31.949842+0000","last_fullsized":"2024-04-26T18:07:31.949842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2757,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656750+0000","last_change":"2024-04-26T18:03:24.989125+0000","last_active":"2024-04-26T18:08:26.656750+0000","last_peered":"2024-04-26T18:08:26.656750+0000","last_clean":"2024-04-26T18:08:26.656750+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:26.656750+0000","last_undegraded":"2024-04-26T18:08:26.656750+0000","last_fullsized":"2024-04-26T18:08:26.656750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:28.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934828+0000","last_change":"2024-04-26T18:03:24.926906+0000","last_active":"2024-04-26T18:05:16.934828+0000","last_peered":"2024-04-26T18:05:16.934828+0000","last_clean":"2024-04-26T18:05:16.934828+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:05:16.934828+0000","last_undegraded":"2024-04-26T18:05:16.934828+0000","last_fullsized":"2024-04-26T18:05:16.934828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:00.232054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:11.934972+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T18:05:11.934972+0000","last_peered":"2024-04-26T18:05:11.934972+0000","last_clean":"2024-04-26T18:05:11.934972+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:05:11.934972+0000","last_undegraded":"2024-04-26T18:05:11.934972+0000","last_fullsized":"2024-04-26T18:05:11.934972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2700,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.659323+0000","last_change":"2024-04-26T18:03:24.996245+0000","last_active":"2024-04-26T18:08:26.659323+0000","last_peered":"2024-04-26T18:08:26.659323+0000","last_clean":"2024-04-26T18:08:26.659323+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:26.659323+0000","last_undegraded":"2024-04-26T18:08:26.659323+0000","last_fullsized":"2024-04-26T18:08:26.659323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:47.633142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'76","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935691+0000","last_change":"2024-04-26T18:03:25.010829+0000","last_active":"2024-04-26T18:05:16.935691+0000","last_peered":"2024-04-26T18:05:16.935691+0000","last_clean":"2024-04-26T18:05:16.935691+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:05:16.935691+0000","last_undegraded":"2024-04-26T18:05:16.935691+0000","last_fullsized":"2024-04-26T18:05:16.935691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:43.796963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949215+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T18:07:31.949215+0000","last_peered":"2024-04-26T18:07:31.949215+0000","last_clean":"2024-04-26T18:07:31.949215+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:07:31.949215+0000","last_undegraded":"2024-04-26T18:07:31.949215+0000","last_fullsized":"2024-04-26T18:07:31.949215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2749,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.079545+0000","last_change":"2024-04-26T18:03:24.641376+0000","last_active":"2024-04-26T18:08:26.079545+0000","last_peered":"2024-04-26T18:08:26.079545+0000","last_clean":"2024-04-26T18:08:26.079545+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:26.079545+0000","last_undegraded":"2024-04-26T18:08:26.079545+0000","last_fullsized":"2024-04-26T18:08:26.079545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.839796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936646+0000","last_change":"2024-04-26T18:03:24.944051+0000","last_active":"2024-04-26T18:05:31.936646+0000","last_peered":"2024-04-26T18:05:31.936646+0000","last_clean":"2024-04-26T18:05:31.936646+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:05:31.936646+0000","last_undegraded":"2024-04-26T18:05:31.936646+0000","last_fullsized":"2024-04-26T18:05:31.936646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:10.353238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'158","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:22.301921+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T18:08:22.301921+0000","last_peered":"2024-04-26T18:08:22.301921+0000","last_clean":"2024-04-26T18:08:22.301921+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:22.301921+0000","last_undegraded":"2024-04-26T18:08:22.301921+0000","last_fullsized":"2024-04-26T18:08:22.301921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.519720+0000","last_change":"2024-04-26T18:03:24.748793+0000","last_active":"2024-04-26T18:08:26.519720+0000","last_peered":"2024-04-26T18:08:26.519720+0000","last_clean":"2024-04-26T18:08:26.519720+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:26.519720+0000","last_undegraded":"2024-04-26T18:08:26.519720+0000","last_fullsized":"2024-04-26T18:08:26.519720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.947294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903472+0000","last_change":"2024-04-26T18:03:24.657577+0000","last_active":"2024-04-26T18:06:10.903472+0000","last_peered":"2024-04-26T18:06:10.903472+0000","last_clean":"2024-04-26T18:06:10.903472+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:06:10.903472+0000","last_undegraded":"2024-04-26T18:06:10.903472+0000","last_fullsized":"2024-04-26T18:06:10.903472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:58.858205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'332","reported_seq":382,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:01.892123+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T18:08:01.892123+0000","last_peered":"2024-04-26T18:08:01.892123+0000","last_clean":"2024-04-26T18:08:01.892123+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:01.892123+0000","last_undegraded":"2024-04-26T18:08:01.892123+0000","last_fullsized":"2024-04-26T18:08:01.892123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.664399+0000","last_change":"2024-04-26T18:03:24.657947+0000","last_active":"2024-04-26T18:08:26.664399+0000","last_peered":"2024-04-26T18:08:26.664399+0000","last_clean":"2024-04-26T18:08:26.664399+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:26.664399+0000","last_undegraded":"2024-04-26T18:08:26.664399+0000","last_fullsized":"2024-04-26T18:08:26.664399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:26.337195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937139+0000","last_change":"2024-04-26T18:03:25.007674+0000","last_active":"2024-04-26T18:05:31.937139+0000","last_peered":"2024-04-26T18:05:31.937139+0000","last_clean":"2024-04-26T18:05:31.937139+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:05:31.937139+0000","last_undegraded":"2024-04-26T18:05:31.937139+0000","last_fullsized":"2024-04-26T18:05:31.937139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:01.233904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'591","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602792+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T18:08:19.602792+0000","last_peered":"2024-04-26T18:08:19.602792+0000","last_clean":"2024-04-26T18:08:19.602792+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:19.602792+0000","last_undegraded":"2024-04-26T18:08:19.602792+0000","last_fullsized":"2024-04-26T18:08:19.602792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2807,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.680572+0000","last_change":"2024-04-26T18:03:24.997268+0000","last_active":"2024-04-26T18:08:26.680572+0000","last_peered":"2024-04-26T18:08:26.680572+0000","last_clean":"2024-04-26T18:08:26.680572+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:26.680572+0000","last_undegraded":"2024-04-26T18:08:26.680572+0000","last_fullsized":"2024-04-26T18:08:26.680572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:53.318883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"34'95","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:46.925955+0000","last_change":"2024-04-26T18:03:24.849449+0000","last_active":"2024-04-26T18:03:46.925955+0000","last_peered":"2024-04-26T18:03:46.925955+0000","last_clean":"2024-04-26T18:03:46.925955+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:03:46.925955+0000","last_undegraded":"2024-04-26T18:03:46.925955+0000","last_fullsized":"2024-04-26T18:03:46.925955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:00.389514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:51.952068+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T18:07:51.952068+0000","last_peered":"2024-04-26T18:07:51.952068+0000","last_clean":"2024-04-26T18:07:51.952068+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:07:51.952068+0000","last_undegraded":"2024-04-26T18:07:51.952068+0000","last_fullsized":"2024-04-26T18:07:51.952068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2805,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.708112+0000","last_change":"2024-04-26T18:03:24.993538+0000","last_active":"2024-04-26T18:08:26.708112+0000","last_peered":"2024-04-26T18:08:26.708112+0000","last_clean":"2024-04-26T18:08:26.708112+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:26.708112+0000","last_undegraded":"2024-04-26T18:08:26.708112+0000","last_fullsized":"2024-04-26T18:08:26.708112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:29.893910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.493317+0000","last_change":"2024-04-26T18:03:25.003948+0000","last_active":"2024-04-26T18:08:26.493317+0000","last_peered":"2024-04-26T18:08:26.493317+0000","last_clean":"2024-04-26T18:08:26.493317+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:26.493317+0000","last_undegraded":"2024-04-26T18:08:26.493317+0000","last_fullsized":"2024-04-26T18:08:26.493317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:07.242676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905320+0000","last_change":"2024-04-26T18:03:24.746669+0000","last_active":"2024-04-26T18:06:10.905320+0000","last_peered":"2024-04-26T18:06:10.905320+0000","last_clean":"2024-04-26T18:06:10.905320+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:06:10.905320+0000","last_undegraded":"2024-04-26T18:06:10.905320+0000","last_fullsized":"2024-04-26T18:06:10.905320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:09.392232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'55","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:24.531223+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T18:08:24.531223+0000","last_peered":"2024-04-26T18:08:24.531223+0000","last_clean":"2024-04-26T18:08:24.531223+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:24.531223+0000","last_undegraded":"2024-04-26T18:08:24.531223+0000","last_fullsized":"2024-04-26T18:08:24.531223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2758,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.433695+0000","last_change":"2024-04-26T18:03:24.635733+0000","last_active":"2024-04-26T18:08:26.433695+0000","last_peered":"2024-04-26T18:08:26.433695+0000","last_clean":"2024-04-26T18:08:26.433695+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:26.433695+0000","last_undegraded":"2024-04-26T18:08:26.433695+0000","last_fullsized":"2024-04-26T18:08:26.433695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:06.120357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'102","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.915184+0000","last_change":"2024-04-26T18:03:24.995053+0000","last_active":"2024-04-26T18:06:37.915184+0000","last_peered":"2024-04-26T18:06:37.915184+0000","last_clean":"2024-04-26T18:06:37.915184+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:06:37.915184+0000","last_undegraded":"2024-04-26T18:06:37.915184+0000","last_fullsized":"2024-04-26T18:06:37.915184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:55.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'26","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:52.001657+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T18:07:52.001657+0000","last_peered":"2024-04-26T18:07:52.001657+0000","last_clean":"2024-04-26T18:07:52.001657+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:07:52.001657+0000","last_undegraded":"2024-04-26T18:07:52.001657+0000","last_fullsized":"2024-04-26T18:07:52.001657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1429","reported_seq":1479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:10.797074+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T18:08:10.797074+0000","last_peered":"2024-04-26T18:08:10.797074+0000","last_clean":"2024-04-26T18:08:10.797074+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:08:10.797074+0000","last_undegraded":"2024-04-26T18:08:10.797074+0000","last_fullsized":"2024-04-26T18:08:10.797074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1429,"log_dups_size":0,"ondisk_log_size":1429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1427,"num_write_kb":17455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938508+0000","last_change":"2024-04-26T18:03:25.011524+0000","last_active":"2024-04-26T18:05:46.938508+0000","last_peered":"2024-04-26T18:05:46.938508+0000","last_clean":"2024-04-26T18:05:46.938508+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:05:46.938508+0000","last_undegraded":"2024-04-26T18:05:46.938508+0000","last_fullsized":"2024-04-26T18:05:46.938508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:37.329300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2733,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.084785+0000","last_change":"2024-04-26T18:03:24.855578+0000","last_active":"2024-04-26T18:08:26.084785+0000","last_peered":"2024-04-26T18:08:26.084785+0000","last_clean":"2024-04-26T18:08:26.084785+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:26.084785+0000","last_undegraded":"2024-04-26T18:08:26.084785+0000","last_fullsized":"2024-04-26T18:08:26.084785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:11.993735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'53","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.720705+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T18:06:45.720705+0000","last_peered":"2024-04-26T18:06:45.720705+0000","last_clean":"2024-04-26T18:06:45.720705+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:06:45.720705+0000","last_undegraded":"2024-04-26T18:06:45.720705+0000","last_fullsized":"2024-04-26T18:06:45.720705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.944631+0000","last_change":"2024-04-26T18:03:24.655256+0000","last_active":"2024-04-26T18:05:46.944631+0000","last_peered":"2024-04-26T18:05:46.944631+0000","last_clean":"2024-04-26T18:05:46.944631+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:05:46.944631+0000","last_undegraded":"2024-04-26T18:05:46.944631+0000","last_fullsized":"2024-04-26T18:05:46.944631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:10.999130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2760,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.582954+0000","last_change":"2024-04-26T18:03:24.995728+0000","last_active":"2024-04-26T18:08:26.582954+0000","last_peered":"2024-04-26T18:08:26.582954+0000","last_clean":"2024-04-26T18:08:26.582954+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:26.582954+0000","last_undegraded":"2024-04-26T18:08:26.582954+0000","last_fullsized":"2024-04-26T18:08:26.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:59.292898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"35'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929463+0000","last_change":"2024-04-26T18:03:24.635879+0000","last_active":"2024-04-26T18:04:31.929463+0000","last_peered":"2024-04-26T18:04:31.929463+0000","last_clean":"2024-04-26T18:04:31.929463+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:04:31.929463+0000","last_undegraded":"2024-04-26T18:04:31.929463+0000","last_fullsized":"2024-04-26T18:04:31.929463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:59.542460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930610+0000","last_change":"2024-04-26T18:03:24.853558+0000","last_active":"2024-04-26T18:04:31.930610+0000","last_peered":"2024-04-26T18:04:31.930610+0000","last_clean":"2024-04-26T18:04:31.930610+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:04:31.930610+0000","last_undegraded":"2024-04-26T18:04:31.930610+0000","last_fullsized":"2024-04-26T18:04:31.930610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:25.997781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'94","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.904089+0000","last_change":"2024-04-26T18:03:24.642154+0000","last_active":"2024-04-26T18:06:10.904089+0000","last_peered":"2024-04-26T18:06:10.904089+0000","last_clean":"2024-04-26T18:06:10.904089+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:06:10.904089+0000","last_undegraded":"2024-04-26T18:06:10.904089+0000","last_fullsized":"2024-04-26T18:06:10.904089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:50.872113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930784+0000","last_change":"2024-04-26T18:03:25.011221+0000","last_active":"2024-04-26T18:04:31.930784+0000","last_peered":"2024-04-26T18:04:31.930784+0000","last_clean":"2024-04-26T18:04:31.930784+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:04:31.930784+0000","last_undegraded":"2024-04-26T18:04:31.930784+0000","last_fullsized":"2024-04-26T18:04:31.930784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:00.133637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932533+0000","last_change":"2024-04-26T18:03:24.996541+0000","last_active":"2024-04-26T18:04:46.932533+0000","last_peered":"2024-04-26T18:04:46.932533+0000","last_clean":"2024-04-26T18:04:46.932533+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:04:46.932533+0000","last_undegraded":"2024-04-26T18:04:46.932533+0000","last_fullsized":"2024-04-26T18:04:46.932533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:21.848231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932437+0000","last_change":"2024-04-26T18:03:24.748158+0000","last_active":"2024-04-26T18:04:46.932437+0000","last_peered":"2024-04-26T18:04:46.932437+0000","last_clean":"2024-04-26T18:04:46.932437+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:04:46.932437+0000","last_undegraded":"2024-04-26T18:04:46.932437+0000","last_fullsized":"2024-04-26T18:04:46.932437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.736661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'94","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931247+0000","last_change":"2024-04-26T18:03:24.637015+0000","last_active":"2024-04-26T18:04:46.931247+0000","last_peered":"2024-04-26T18:04:46.931247+0000","last_clean":"2024-04-26T18:04:46.931247+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:04:46.931247+0000","last_undegraded":"2024-04-26T18:04:46.931247+0000","last_fullsized":"2024-04-26T18:04:46.931247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:53.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"35'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932554+0000","last_change":"2024-04-26T18:03:24.988961+0000","last_active":"2024-04-26T18:04:46.932554+0000","last_peered":"2024-04-26T18:04:46.932554+0000","last_clean":"2024-04-26T18:04:46.932554+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:04:46.932554+0000","last_undegraded":"2024-04-26T18:04:46.932554+0000","last_fullsized":"2024-04-26T18:04:46.932554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:44.663355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'85","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931167+0000","last_change":"2024-04-26T18:03:24.637315+0000","last_active":"2024-04-26T18:04:46.931167+0000","last_peered":"2024-04-26T18:04:46.931167+0000","last_clean":"2024-04-26T18:04:46.931167+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:04:46.931167+0000","last_undegraded":"2024-04-26T18:04:46.931167+0000","last_fullsized":"2024-04-26T18:04:46.931167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:28.067247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934135+0000","last_change":"2024-04-26T18:03:24.989182+0000","last_active":"2024-04-26T18:05:01.934135+0000","last_peered":"2024-04-26T18:05:01.934135+0000","last_clean":"2024-04-26T18:05:01.934135+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:05:01.934135+0000","last_undegraded":"2024-04-26T18:05:01.934135+0000","last_fullsized":"2024-04-26T18:05:01.934135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:40.391182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'85","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:41.937620+0000","last_change":"2024-04-26T18:03:24.852287+0000","last_active":"2024-04-26T18:05:41.937620+0000","last_peered":"2024-04-26T18:05:41.937620+0000","last_clean":"2024-04-26T18:05:41.937620+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:05:41.937620+0000","last_undegraded":"2024-04-26T18:05:41.937620+0000","last_fullsized":"2024-04-26T18:05:41.937620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:31.793462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'79","reported_seq":2148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933958+0000","last_change":"2024-04-26T18:03:25.009931+0000","last_active":"2024-04-26T18:05:01.933958+0000","last_peered":"2024-04-26T18:05:01.933958+0000","last_clean":"2024-04-26T18:05:01.933958+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:05:01.933958+0000","last_undegraded":"2024-04-26T18:05:01.933958+0000","last_fullsized":"2024-04-26T18:05:01.933958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:15.705947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933102+0000","last_change":"2024-04-26T18:03:24.637292+0000","last_active":"2024-04-26T18:05:01.933102+0000","last_peered":"2024-04-26T18:05:01.933102+0000","last_clean":"2024-04-26T18:05:01.933102+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:05:01.933102+0000","last_undegraded":"2024-04-26T18:05:01.933102+0000","last_fullsized":"2024-04-26T18:05:01.933102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:27.406729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933137+0000","last_change":"2024-04-26T18:03:24.944245+0000","last_active":"2024-04-26T18:05:01.933137+0000","last_peered":"2024-04-26T18:05:01.933137+0000","last_clean":"2024-04-26T18:05:01.933137+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:05:01.933137+0000","last_undegraded":"2024-04-26T18:05:01.933137+0000","last_fullsized":"2024-04-26T18:05:01.933137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:06.577309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935431+0000","last_change":"2024-04-26T18:03:24.851534+0000","last_active":"2024-04-26T18:05:16.935431+0000","last_peered":"2024-04-26T18:05:16.935431+0000","last_clean":"2024-04-26T18:05:16.935431+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:05:16.935431+0000","last_undegraded":"2024-04-26T18:05:16.935431+0000","last_fullsized":"2024-04-26T18:05:16.935431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:49.815792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'86","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935510+0000","last_change":"2024-04-26T18:03:24.642437+0000","last_active":"2024-04-26T18:05:16.935510+0000","last_peered":"2024-04-26T18:05:16.935510+0000","last_clean":"2024-04-26T18:05:16.935510+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:05:16.935510+0000","last_undegraded":"2024-04-26T18:05:16.935510+0000","last_fullsized":"2024-04-26T18:05:16.935510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'88","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935454+0000","last_change":"2024-04-26T18:03:24.635610+0000","last_active":"2024-04-26T18:05:16.935454+0000","last_peered":"2024-04-26T18:05:16.935454+0000","last_clean":"2024-04-26T18:05:16.935454+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:05:16.935454+0000","last_undegraded":"2024-04-26T18:05:16.935454+0000","last_fullsized":"2024-04-26T18:05:16.935454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:01.517984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.936205+0000","last_change":"2024-04-26T18:03:24.746082+0000","last_active":"2024-04-26T18:05:16.936205+0000","last_peered":"2024-04-26T18:05:16.936205+0000","last_clean":"2024-04-26T18:05:16.936205+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:05:16.936205+0000","last_undegraded":"2024-04-26T18:05:16.936205+0000","last_fullsized":"2024-04-26T18:05:16.936205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:01.306469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935675+0000","last_change":"2024-04-26T18:03:25.011535+0000","last_active":"2024-04-26T18:05:16.935675+0000","last_peered":"2024-04-26T18:05:16.935675+0000","last_clean":"2024-04-26T18:05:16.935675+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:05:16.935675+0000","last_undegraded":"2024-04-26T18:05:16.935675+0000","last_fullsized":"2024-04-26T18:05:16.935675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:59.943859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.938476+0000","last_change":"2024-04-26T18:03:24.968688+0000","last_active":"2024-04-26T18:05:31.938476+0000","last_peered":"2024-04-26T18:05:31.938476+0000","last_clean":"2024-04-26T18:05:31.938476+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:05:31.938476+0000","last_undegraded":"2024-04-26T18:05:31.938476+0000","last_fullsized":"2024-04-26T18:05:31.938476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:44.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"34'69","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.943075+0000","last_change":"2024-04-26T18:03:24.656824+0000","last_active":"2024-04-26T18:05:31.943075+0000","last_peered":"2024-04-26T18:05:31.943075+0000","last_clean":"2024-04-26T18:05:31.943075+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:05:31.943075+0000","last_undegraded":"2024-04-26T18:05:31.943075+0000","last_fullsized":"2024-04-26T18:05:31.943075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:16.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903023+0000","last_change":"2024-04-26T18:03:24.634849+0000","last_active":"2024-04-26T18:06:10.903023+0000","last_peered":"2024-04-26T18:06:10.903023+0000","last_clean":"2024-04-26T18:06:10.903023+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:06:10.903023+0000","last_undegraded":"2024-04-26T18:06:10.903023+0000","last_fullsized":"2024-04-26T18:06:10.903023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.994234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937001+0000","last_change":"2024-04-26T18:03:24.636282+0000","last_active":"2024-04-26T18:05:31.937001+0000","last_peered":"2024-04-26T18:05:31.937001+0000","last_clean":"2024-04-26T18:05:31.937001+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:05:31.937001+0000","last_undegraded":"2024-04-26T18:05:31.937001+0000","last_fullsized":"2024-04-26T18:05:31.937001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:07.014169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'73","reported_seq":2142,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936681+0000","last_change":"2024-04-26T18:03:24.946554+0000","last_active":"2024-04-26T18:05:31.936681+0000","last_peered":"2024-04-26T18:05:31.936681+0000","last_clean":"2024-04-26T18:05:31.936681+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:05:31.936681+0000","last_undegraded":"2024-04-26T18:05:31.936681+0000","last_fullsized":"2024-04-26T18:05:31.936681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:44.578641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"34'65","reported_seq":2134,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.939780+0000","last_change":"2024-04-26T18:03:24.995186+0000","last_active":"2024-04-26T18:05:46.939780+0000","last_peered":"2024-04-26T18:05:46.939780+0000","last_clean":"2024-04-26T18:05:46.939780+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:05:46.939780+0000","last_undegraded":"2024-04-26T18:05:46.939780+0000","last_fullsized":"2024-04-26T18:05:46.939780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:02.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'99","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938480+0000","last_change":"2024-04-26T18:03:24.942130+0000","last_active":"2024-04-26T18:05:46.938480+0000","last_peered":"2024-04-26T18:05:46.938480+0000","last_clean":"2024-04-26T18:05:46.938480+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:05:46.938480+0000","last_undegraded":"2024-04-26T18:05:46.938480+0000","last_fullsized":"2024-04-26T18:05:46.938480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:58.029188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'86","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:56.926877+0000","last_change":"2024-04-26T18:03:24.852029+0000","last_active":"2024-04-26T18:03:56.926877+0000","last_peered":"2024-04-26T18:03:56.926877+0000","last_clean":"2024-04-26T18:03:56.926877+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:03:56.926877+0000","last_undegraded":"2024-04-26T18:03:56.926877+0000","last_fullsized":"2024-04-26T18:03:56.926877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:23.464299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938521+0000","last_change":"2024-04-26T18:03:24.932964+0000","last_active":"2024-04-26T18:05:46.938521+0000","last_peered":"2024-04-26T18:05:46.938521+0000","last_clean":"2024-04-26T18:05:46.938521+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:05:46.938521+0000","last_undegraded":"2024-04-26T18:05:46.938521+0000","last_fullsized":"2024-04-26T18:05:46.938521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:24.157039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941580+0000","last_change":"2024-04-26T18:03:24.641802+0000","last_active":"2024-04-26T18:06:16.941580+0000","last_peered":"2024-04-26T18:06:16.941580+0000","last_clean":"2024-04-26T18:06:16.941580+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:06:16.941580+0000","last_undegraded":"2024-04-26T18:06:16.941580+0000","last_fullsized":"2024-04-26T18:06:16.941580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:18:40.921369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930799+0000","last_change":"2024-04-26T18:03:25.004919+0000","last_active":"2024-04-26T18:04:31.930799+0000","last_peered":"2024-04-26T18:04:31.930799+0000","last_clean":"2024-04-26T18:04:31.930799+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:04:31.930799+0000","last_undegraded":"2024-04-26T18:04:31.930799+0000","last_fullsized":"2024-04-26T18:04:31.930799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:52.306796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:42.865142+0000","last_change":"2024-04-26T18:03:24.745389+0000","last_active":"2024-04-26T18:04:42.865142+0000","last_peered":"2024-04-26T18:04:42.865142+0000","last_clean":"2024-04-26T18:04:42.865142+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:04:42.865142+0000","last_undegraded":"2024-04-26T18:04:42.865142+0000","last_fullsized":"2024-04-26T18:04:42.865142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:12.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929496+0000","last_change":"2024-04-26T18:03:24.945776+0000","last_active":"2024-04-26T18:04:31.929496+0000","last_peered":"2024-04-26T18:04:31.929496+0000","last_clean":"2024-04-26T18:04:31.929496+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:04:31.929496+0000","last_undegraded":"2024-04-26T18:04:31.929496+0000","last_fullsized":"2024-04-26T18:04:31.929496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:13.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5276,"ondisk_log_size":5276,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":227070368,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8619,"num_write_kb":230563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454197248,"data_stored":454140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8258,"ondisk_log_size":8258,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":285960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":292823040,"data_stored":292603949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441680,"kb_used_data":330056,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93930160,"statfs":{"total":96636764160,"available":96184483840,"internally_reserved":0,"allocated":337977344,"data_stored":337757799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336168,"kb_used_data":255008,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94035672,"statfs":{"total":96636764160,"available":96292528128,"internally_reserved":0,"allocated":261128192,"data_stored":260910302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416472,"kb_used_data":304784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93955368,"statfs":{"total":96636764160,"available":96210296832,"internally_reserved":0,"allocated":312098816,"data_stored":311872770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514900,"kb_used_data":389324,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":93856940,"statfs":{"total":96636764160,"available":96109506560,"internally_reserved":0,"allocated":398667776,"data_stored":398447177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273200,"kb_used_data":197608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94098640,"statfs":{"total":96636764160,"available":96357007360,"internally_reserved":0,"allocated":202350592,"data_stored":202137513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481284,"kb_used_data":369596,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93890556,"statfs":{"total":96636764160,"available":96143929344,"internally_reserved":0,"allocated":378466304,"data_stored":378246247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349180,"kb_used_data":255540,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94022660,"statfs":{"total":96636764160,"available":96279203840,"internally_reserved":0,"allocated":261672960,"data_stored":261445733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58728448,"data_stored":58720416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46723072,"data_stored":46714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62918656,"data_stored":62914650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71311360,"data_stored":71303840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:08:29.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:08:29.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.719+0000 7f4d4c57f640 1 Processor -- start 2024-04-26T18:08:29.720 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.720+0000 7f4d4c57f640 1 -- start start 2024-04-26T18:08:29.723 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.720+0000 7f4d4c57f640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4d440b4370 0x7f4d4415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4c57f640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4415fa00 con 0x7f4d440ce070 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4c57f640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d4415fce0 con 0x7f4d440ce450 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4c57f640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f4d440cc090 con 0x7f4d440b4370 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4a31b640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d440ce070 0x7f4d4415f1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46580/0 (socket says 172.21.15.12:46580) 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4a31b640 1 -- 172.21.15.12:0/2879991919 learned_addr learned my addr 172.21.15.12:0/2879991919 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:29.724 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49b1a640 1 --2- 172.21.15.12:0/2879991919 >> v2:172.21.15.100:3300/0 conn(0x7f4d440b4370 0x7f4d4415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3562957635 0 0) 0x7f4d4415fa00 con 0x7f4d440ce070 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d2c003520 con 0x7f4d440ce070 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3989533614 0 0) 0x7f4d2c003520 con 0x7f4d440ce070 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 >> v2:172.21.15.100:3300/0 conn(0x7f4d440b4370 msgr2=0x7f4d4415bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 --2- 172.21.15.12:0/2879991919 >> v2:172.21.15.100:3300/0 conn(0x7f4d440b4370 0x7f4d4415bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 >> v1:172.21.15.100:6789/0 conn(0x7f4d440ce450 legacy=0x7f4d440ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4415ffc0 con 0x7f4d440ce070 2024-04-26T18:08:29.725 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f4d3c001670 con 0x7f4d440ce070 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 >> v1:172.21.15.12:6789/0 conn(0x7f4d440ce070 legacy=0x7f4d4415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0039b0 0x7f4d2c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 0x7f4d2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440cc090 con 0x7f4d2c005210 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2c00c140 con 0x7f4d2c0039b0 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2c00c340 con 0x7f4d2c004800 2024-04-26T18:08:29.726 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4ab1c640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 0x7f4d2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.721+0000 7f4d4a31b640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0039b0 0x7f4d2c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d49b1a640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 -- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d2c004800 msgr2=0x7f4d2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d2c004800 0x7f4d2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 -- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0039b0 msgr2=0x7f4d2c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c0039b0 0x7f4d2c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 -- 172.21.15.12:0/2879991919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2c003520 con 0x7f4d2c005210 2024-04-26T18:08:29.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 -- 172.21.15.12:0/2879991919 reap_dead start 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.722+0000 7f4d4ab1c640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 0x7f4d2c00b9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d34001e20 tx=0x7f4d2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0da47e831e839d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34001a70 con 0x7f4d2c005210 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3402ae40 con 0x7f4d2c005210 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d49319640 1 -- 172.21.15.12:0/2879991919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003b90 con 0x7f4d2c005210 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 -- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 msgr2=0x7f4d2c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 0x7f4d2c00b9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d34001e20 tx=0x7f4d2c005830 comp rx=0 tx=0).stop 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 -- 172.21.15.12:0/2879991919 shutdown_connections 2024-04-26T18:08:29.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/2879991919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d2c005210 0x7f4d2c00b9c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 -- 172.21.15.12:0/2879991919 >> 172.21.15.12:0/2879991919 conn(0x7f4d440743c0 msgr2=0x7f4d44068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:29.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 -- 172.21.15.12:0/2879991919 shutdown_connections 2024-04-26T18:08:29.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.723+0000 7f4d4c57f640 1 -- 172.21.15.12:0/2879991919 wait complete. 2024-04-26T18:08:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.724+0000 7f4d4c57f640 1 Processor -- start 2024-04-26T18:08:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.724+0000 7f4d4c57f640 1 -- start start 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c005210 0x7f4d441f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d44151b60 0x7f4d4414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4415bbd0 con 0x7f4d440d0780 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4d440cc5c0 con 0x7f4d2c005210 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4c57f640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4415bd50 con 0x7f4d44151b60 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d49b1a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d49b1a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41216/0 (socket says 172.21.15.12:41216) 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d49b1a640 1 -- 172.21.15.12:0/781418614 learned_addr learned my addr 172.21.15.12:0/781418614 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4ab1c640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d44151b60 0x7f4d4414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.725+0000 7f4d4a31b640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c005210 0x7f4d441f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 -- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d44151b60 msgr2=0x7f4d4414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d44151b60 0x7f4d4414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 -- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c005210 msgr2=0x7f4d441f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c005210 0x7f4d441f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 -- 172.21.15.12:0/781418614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d441f2960 con 0x7f4d440d0780 2024-04-26T18:08:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d49b1a640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d38011910 tx=0x7f4d38011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3800fa30 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3800fbd0 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d44156660 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38014440 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.726+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d441f1c20 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.727+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d44156b80 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.727+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d38012040 con 0x7f4d440d0780 2024-04-26T18:08:29.735 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.728+0000 7f4d42ffd640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 0x7f4d3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.728+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4d3808c4b0 con 0x7f4d440d0780 2024-04-26T18:08:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.728+0000 7f4d4a31b640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 0x7f4d3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.728+0000 7f4d4a31b640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 0x7f4d3006ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c000fb0 tx=0x7f4d3c0078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:29.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.732+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4d44156b80 con 0x7f4d440d0780 2024-04-26T18:08:29.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.914+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4d440c64e0 con 0x7f4d3006c920 2024-04-26T18:08:29.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.922+0000 7f4d42ffd640 1 -- 172.21.15.12:0/781418614 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336588 (secure 0 0 0) 0x7f4d440c64e0 con 0x7f4d3006c920 2024-04-26T18:08:29.926 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:29.928 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.925+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 msgr2=0x7f4d3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.925+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 0x7f4d3006ede0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c000fb0 tx=0x7f4d3c0078f0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 msgr2=0x7f4d440b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d38011910 tx=0x7f4d38011d10 comp rx=0 tx=0).stop 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 shutdown_connections 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4d3006c920 0x7f4d3006ede0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.930 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4d44151b60 0x7f4d4414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d440d0780 0x7f4d440b6c30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 --2- 172.21.15.12:0/781418614 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d2c005210 0x7f4d441f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 >> 172.21.15.12:0/781418614 conn(0x7f4d440743c0 msgr2=0x7f4d4415a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 shutdown_connections 2024-04-26T18:08:29.931 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:29.926+0000 7f4d4c57f640 1 -- 172.21.15.12:0/781418614 wait complete. 2024-04-26T18:08:29.937 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-04-26T18:08:28.033657+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1177407960,"num_objects":10787,"num_object_clones":0,"num_object_copies":42846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10787,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30231,"num_write_kb":1777170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35133,"ondisk_log_size":35133,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3184164,"kb_used_data":2387876,"kb_used_omap":12,"kb_used_meta":796211,"kb_avail":751790556,"statfs":{"total":773094113280,"available":769833529344,"internally_reserved":0,"allocated":2445185024,"data_stored":2443421490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":815320624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":69348736,"num_objects":2504,"num_object_clones":0,"num_object_copies":9938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2504,"num_whiteouts":0,"num_read":10,"num_read_kb":24528,"num_write":2736,"num_write_kb":69936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":32,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003383"},"pg_stats":[{"pgid":"2.1f","version":"36'123","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655962+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T18:06:59.655962+0000","last_peered":"2024-04-26T18:06:59.655962+0000","last_clean":"2024-04-26T18:06:59.655962+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:06:59.655962+0000","last_undegraded":"2024-04-26T18:06:59.655962+0000","last_fullsized":"2024-04-26T18:06:59.655962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'87","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.943078+0000","last_change":"2024-04-26T18:03:24.967895+0000","last_active":"2024-04-26T18:06:16.943078+0000","last_peered":"2024-04-26T18:06:16.943078+0000","last_clean":"2024-04-26T18:06:16.943078+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:06:16.943078+0000","last_undegraded":"2024-04-26T18:06:16.943078+0000","last_fullsized":"2024-04-26T18:06:16.943078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:40.112811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.700846+0000","last_change":"2024-04-26T18:03:24.991152+0000","last_active":"2024-04-26T18:08:26.700846+0000","last_peered":"2024-04-26T18:08:26.700846+0000","last_clean":"2024-04-26T18:08:26.700846+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:26.700846+0000","last_undegraded":"2024-04-26T18:08:26.700846+0000","last_fullsized":"2024-04-26T18:08:26.700846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:03.026992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1624","reported_seq":1675,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.655650+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T18:08:19.655650+0000","last_peered":"2024-04-26T18:08:19.655650+0000","last_clean":"2024-04-26T18:08:19.655650+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:19.655650+0000","last_undegraded":"2024-04-26T18:08:19.655650+0000","last_fullsized":"2024-04-26T18:08:19.655650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930816+0000","last_change":"2024-04-26T18:03:25.006390+0000","last_active":"2024-04-26T18:04:31.930816+0000","last_peered":"2024-04-26T18:04:31.930816+0000","last_clean":"2024-04-26T18:04:31.930816+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:04:31.930816+0000","last_undegraded":"2024-04-26T18:04:31.930816+0000","last_fullsized":"2024-04-26T18:04:31.930816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:42.430689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2789,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678592+0000","last_change":"2024-04-26T18:03:24.654455+0000","last_active":"2024-04-26T18:08:26.678592+0000","last_peered":"2024-04-26T18:08:26.678592+0000","last_clean":"2024-04-26T18:08:26.678592+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:26.678592+0000","last_undegraded":"2024-04-26T18:08:26.678592+0000","last_fullsized":"2024-04-26T18:08:26.678592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.834932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'722","reported_seq":772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372121+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T18:08:14.372121+0000","last_peered":"2024-04-26T18:08:14.372121+0000","last_clean":"2024-04-26T18:08:14.372121+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:14.372121+0000","last_undegraded":"2024-04-26T18:08:14.372121+0000","last_fullsized":"2024-04-26T18:08:14.372121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'82","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938591+0000","last_change":"2024-04-26T18:03:24.642146+0000","last_active":"2024-04-26T18:05:46.938591+0000","last_peered":"2024-04-26T18:05:46.938591+0000","last_clean":"2024-04-26T18:05:46.938591+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:05:46.938591+0000","last_undegraded":"2024-04-26T18:05:46.938591+0000","last_fullsized":"2024-04-26T18:05:46.938591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:42.065227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678605+0000","last_change":"2024-04-26T18:03:24.657679+0000","last_active":"2024-04-26T18:08:26.678605+0000","last_peered":"2024-04-26T18:08:26.678605+0000","last_clean":"2024-04-26T18:08:26.678605+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:26.678605+0000","last_undegraded":"2024-04-26T18:08:26.678605+0000","last_fullsized":"2024-04-26T18:08:26.678605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:45.442811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'165","reported_seq":215,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.603071+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T18:08:19.603071+0000","last_peered":"2024-04-26T18:08:19.603071+0000","last_clean":"2024-04-26T18:08:19.603071+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:19.603071+0000","last_undegraded":"2024-04-26T18:08:19.603071+0000","last_fullsized":"2024-04-26T18:08:19.603071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'75","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:38.915794+0000","last_change":"2024-04-26T18:03:24.641061+0000","last_active":"2024-04-26T18:06:38.915794+0000","last_peered":"2024-04-26T18:06:38.915794+0000","last_clean":"2024-04-26T18:06:38.915794+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:06:38.915794+0000","last_undegraded":"2024-04-26T18:06:38.915794+0000","last_fullsized":"2024-04-26T18:06:38.915794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:45.214146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494273+0000","last_change":"2024-04-26T18:03:24.655979+0000","last_active":"2024-04-26T18:08:26.494273+0000","last_peered":"2024-04-26T18:08:26.494273+0000","last_clean":"2024-04-26T18:08:26.494273+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:26.494273+0000","last_undegraded":"2024-04-26T18:08:26.494273+0000","last_fullsized":"2024-04-26T18:08:26.494273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:20.235120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931210+0000","last_change":"2024-04-26T18:03:24.635966+0000","last_active":"2024-04-26T18:04:46.931210+0000","last_peered":"2024-04-26T18:04:46.931210+0000","last_clean":"2024-04-26T18:04:46.931210+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:04:46.931210+0000","last_undegraded":"2024-04-26T18:04:46.931210+0000","last_fullsized":"2024-04-26T18:04:46.931210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:08.113204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'224","reported_seq":274,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655859+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T18:06:59.655859+0000","last_peered":"2024-04-26T18:06:59.655859+0000","last_clean":"2024-04-26T18:06:59.655859+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:06:59.655859+0000","last_undegraded":"2024-04-26T18:06:59.655859+0000","last_fullsized":"2024-04-26T18:06:59.655859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656882+0000","last_change":"2024-04-26T18:03:24.657047+0000","last_active":"2024-04-26T18:08:26.656882+0000","last_peered":"2024-04-26T18:08:26.656882+0000","last_clean":"2024-04-26T18:08:26.656882+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:26.656882+0000","last_undegraded":"2024-04-26T18:08:26.656882+0000","last_fullsized":"2024-04-26T18:08:26.656882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:12.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934167+0000","last_change":"2024-04-26T18:03:24.972452+0000","last_active":"2024-04-26T18:05:01.934167+0000","last_peered":"2024-04-26T18:05:01.934167+0000","last_clean":"2024-04-26T18:05:01.934167+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:05:01.934167+0000","last_undegraded":"2024-04-26T18:05:01.934167+0000","last_fullsized":"2024-04-26T18:05:01.934167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:22.285266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'837","reported_seq":887,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:14.564924+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T18:07:14.564924+0000","last_peered":"2024-04-26T18:07:14.564924+0000","last_clean":"2024-04-26T18:07:14.564924+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:07:14.564924+0000","last_undegraded":"2024-04-26T18:07:14.564924+0000","last_fullsized":"2024-04-26T18:07:14.564924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":8790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.491409+0000","last_change":"2024-04-26T18:03:24.656810+0000","last_active":"2024-04-26T18:08:26.491409+0000","last_peered":"2024-04-26T18:08:26.491409+0000","last_clean":"2024-04-26T18:08:26.491409+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:26.491409+0000","last_undegraded":"2024-04-26T18:08:26.491409+0000","last_fullsized":"2024-04-26T18:08:26.491409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:58.022914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905447+0000","last_change":"2024-04-26T18:03:24.996978+0000","last_active":"2024-04-26T18:06:10.905447+0000","last_peered":"2024-04-26T18:06:10.905447+0000","last_clean":"2024-04-26T18:06:10.905447+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:06:10.905447+0000","last_undegraded":"2024-04-26T18:06:10.905447+0000","last_fullsized":"2024-04-26T18:06:10.905447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.166776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'70","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372832+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T18:08:14.372832+0000","last_peered":"2024-04-26T18:08:14.372832+0000","last_clean":"2024-04-26T18:08:14.372832+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:14.372832+0000","last_undegraded":"2024-04-26T18:08:14.372832+0000","last_fullsized":"2024-04-26T18:08:14.372832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2794,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640445+0000","last_change":"2024-04-26T18:03:24.748206+0000","last_active":"2024-04-26T18:08:26.640445+0000","last_peered":"2024-04-26T18:08:26.640445+0000","last_clean":"2024-04-26T18:08:26.640445+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:26.640445+0000","last_undegraded":"2024-04-26T18:08:26.640445+0000","last_fullsized":"2024-04-26T18:08:26.640445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:03.632839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'91","reported_seq":2160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.937288+0000","last_change":"2024-04-26T18:03:24.656039+0000","last_active":"2024-04-26T18:04:46.937288+0000","last_peered":"2024-04-26T18:04:46.937288+0000","last_clean":"2024-04-26T18:04:46.937288+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:04:46.937288+0000","last_undegraded":"2024-04-26T18:04:46.937288+0000","last_fullsized":"2024-04-26T18:04:46.937288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:46.594712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'7","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.755314+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T18:06:59.755314+0000","last_peered":"2024-04-26T18:06:59.755314+0000","last_clean":"2024-04-26T18:06:59.755314+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:06:59.755314+0000","last_undegraded":"2024-04-26T18:06:59.755314+0000","last_fullsized":"2024-04-26T18:06:59.755314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.473190+0000","last_change":"2024-04-26T18:03:24.656487+0000","last_active":"2024-04-26T18:08:26.473190+0000","last_peered":"2024-04-26T18:08:26.473190+0000","last_clean":"2024-04-26T18:08:26.473190+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:26.473190+0000","last_undegraded":"2024-04-26T18:08:26.473190+0000","last_fullsized":"2024-04-26T18:08:26.473190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:09.597061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932205+0000","last_change":"2024-04-26T18:03:25.006124+0000","last_active":"2024-04-26T18:04:46.932205+0000","last_peered":"2024-04-26T18:04:46.932205+0000","last_clean":"2024-04-26T18:04:46.932205+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:04:46.932205+0000","last_undegraded":"2024-04-26T18:04:46.932205+0000","last_fullsized":"2024-04-26T18:04:46.932205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:50.782589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'192","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:41.930694+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T18:04:41.930694+0000","last_peered":"2024-04-26T18:04:41.930694+0000","last_clean":"2024-04-26T18:04:41.930694+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:04:41.930694+0000","last_undegraded":"2024-04-26T18:04:41.930694+0000","last_fullsized":"2024-04-26T18:04:41.930694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2799,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.633174+0000","last_change":"2024-04-26T18:03:24.655017+0000","last_active":"2024-04-26T18:08:26.633174+0000","last_peered":"2024-04-26T18:08:26.633174+0000","last_clean":"2024-04-26T18:08:26.633174+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:26.633174+0000","last_undegraded":"2024-04-26T18:08:26.633174+0000","last_fullsized":"2024-04-26T18:08:26.633174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:34.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'83","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:26.937150+0000","last_change":"2024-04-26T18:03:24.746543+0000","last_active":"2024-04-26T18:05:26.937150+0000","last_peered":"2024-04-26T18:05:26.937150+0000","last_clean":"2024-04-26T18:05:26.937150+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:05:26.937150+0000","last_undegraded":"2024-04-26T18:05:26.937150+0000","last_fullsized":"2024-04-26T18:05:26.937150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:51.534255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'258","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.976486+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T18:08:23.976486+0000","last_peered":"2024-04-26T18:08:23.976486+0000","last_clean":"2024-04-26T18:08:23.976486+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:23.976486+0000","last_undegraded":"2024-04-26T18:08:23.976486+0000","last_fullsized":"2024-04-26T18:08:23.976486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2829,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.689970+0000","last_change":"2024-04-26T18:03:24.996787+0000","last_active":"2024-04-26T18:08:26.689970+0000","last_peered":"2024-04-26T18:08:26.689970+0000","last_clean":"2024-04-26T18:08:26.689970+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:26.689970+0000","last_undegraded":"2024-04-26T18:08:26.689970+0000","last_fullsized":"2024-04-26T18:08:26.689970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930926+0000","last_change":"2024-04-26T18:03:24.747226+0000","last_active":"2024-04-26T18:04:31.930926+0000","last_peered":"2024-04-26T18:04:31.930926+0000","last_clean":"2024-04-26T18:04:31.930926+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:04:31.930926+0000","last_undegraded":"2024-04-26T18:04:31.930926+0000","last_fullsized":"2024-04-26T18:04:31.930926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.708780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'145","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.147385+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T18:06:37.147385+0000","last_peered":"2024-04-26T18:06:37.147385+0000","last_clean":"2024-04-26T18:06:37.147385+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:06:37.147385+0000","last_undegraded":"2024-04-26T18:06:37.147385+0000","last_fullsized":"2024-04-26T18:06:37.147385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.331133+0000","last_change":"2024-04-26T18:03:25.011835+0000","last_active":"2024-04-26T18:08:26.331133+0000","last_peered":"2024-04-26T18:08:26.331133+0000","last_clean":"2024-04-26T18:08:26.331133+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:26.331133+0000","last_undegraded":"2024-04-26T18:08:26.331133+0000","last_fullsized":"2024-04-26T18:08:26.331133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.743889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'79","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929493+0000","last_change":"2024-04-26T18:03:24.641851+0000","last_active":"2024-04-26T18:04:31.929493+0000","last_peered":"2024-04-26T18:04:31.929493+0000","last_clean":"2024-04-26T18:04:31.929493+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:04:31.929493+0000","last_undegraded":"2024-04-26T18:04:31.929493+0000","last_fullsized":"2024-04-26T18:04:31.929493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:05.076764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'132","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602929+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T18:08:19.602929+0000","last_peered":"2024-04-26T18:08:19.602929+0000","last_clean":"2024-04-26T18:08:19.602929+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:19.602929+0000","last_undegraded":"2024-04-26T18:08:19.602929+0000","last_fullsized":"2024-04-26T18:08:19.602929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.532024+0000","last_change":"2024-04-26T18:03:24.748734+0000","last_active":"2024-04-26T18:08:26.532024+0000","last_peered":"2024-04-26T18:08:26.532024+0000","last_clean":"2024-04-26T18:08:26.532024+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:26.532024+0000","last_undegraded":"2024-04-26T18:08:26.532024+0000","last_fullsized":"2024-04-26T18:08:26.532024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:50.548538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'89","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.871972+0000","last_change":"2024-04-26T18:03:24.657308+0000","last_active":"2024-04-26T18:05:06.871972+0000","last_peered":"2024-04-26T18:05:06.871972+0000","last_clean":"2024-04-26T18:05:06.871972+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:05:06.871972+0000","last_undegraded":"2024-04-26T18:05:06.871972+0000","last_fullsized":"2024-04-26T18:05:06.871972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:50.688884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.654871+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T18:06:59.654871+0000","last_peered":"2024-04-26T18:06:59.654871+0000","last_clean":"2024-04-26T18:06:59.654871+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:06:59.654871+0000","last_undegraded":"2024-04-26T18:06:59.654871+0000","last_fullsized":"2024-04-26T18:06:59.654871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2738,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.524101+0000","last_change":"2024-04-26T18:03:24.747715+0000","last_active":"2024-04-26T18:08:26.524101+0000","last_peered":"2024-04-26T18:08:26.524101+0000","last_clean":"2024-04-26T18:08:26.524101+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:26.524101+0000","last_undegraded":"2024-04-26T18:08:26.524101+0000","last_fullsized":"2024-04-26T18:08:26.524101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:59.495568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"34'75","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941608+0000","last_change":"2024-04-26T18:03:24.749179+0000","last_active":"2024-04-26T18:06:16.941608+0000","last_peered":"2024-04-26T18:06:16.941608+0000","last_clean":"2024-04-26T18:06:16.941608+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:06:16.941608+0000","last_undegraded":"2024-04-26T18:06:16.941608+0000","last_fullsized":"2024-04-26T18:06:16.941608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:10.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'124","reported_seq":294,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.718532+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T18:06:45.718532+0000","last_peered":"2024-04-26T18:06:45.718532+0000","last_clean":"2024-04-26T18:06:45.718532+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:06:45.718532+0000","last_undegraded":"2024-04-26T18:06:45.718532+0000","last_fullsized":"2024-04-26T18:06:45.718532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2744,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640670+0000","last_change":"2024-04-26T18:03:24.748508+0000","last_active":"2024-04-26T18:08:26.640670+0000","last_peered":"2024-04-26T18:08:26.640670+0000","last_clean":"2024-04-26T18:08:26.640670+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:26.640670+0000","last_undegraded":"2024-04-26T18:08:26.640670+0000","last_fullsized":"2024-04-26T18:08:26.640670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:08:50.836401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"35'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930743+0000","last_change":"2024-04-26T18:03:25.001751+0000","last_active":"2024-04-26T18:04:31.930743+0000","last_peered":"2024-04-26T18:04:31.930743+0000","last_clean":"2024-04-26T18:04:31.930743+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:04:31.930743+0000","last_undegraded":"2024-04-26T18:04:31.930743+0000","last_fullsized":"2024-04-26T18:04:31.930743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'250","reported_seq":301,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:11.941507+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T18:06:11.941507+0000","last_peered":"2024-04-26T18:06:11.941507+0000","last_clean":"2024-04-26T18:06:11.941507+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:06:11.941507+0000","last_undegraded":"2024-04-26T18:06:11.941507+0000","last_fullsized":"2024-04-26T18:06:11.941507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494713+0000","last_change":"2024-04-26T18:03:25.005985+0000","last_active":"2024-04-26T18:08:26.494713+0000","last_peered":"2024-04-26T18:08:26.494713+0000","last_clean":"2024-04-26T18:08:26.494713+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:26.494713+0000","last_undegraded":"2024-04-26T18:08:26.494713+0000","last_fullsized":"2024-04-26T18:08:26.494713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:46.423765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.880149+0000","last_change":"2024-04-26T18:03:24.984011+0000","last_active":"2024-04-26T18:05:06.880149+0000","last_peered":"2024-04-26T18:05:06.880149+0000","last_clean":"2024-04-26T18:05:06.880149+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:05:06.880149+0000","last_undegraded":"2024-04-26T18:05:06.880149+0000","last_fullsized":"2024-04-26T18:05:06.880149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:09.171009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'113","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:31.943358+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T18:06:31.943358+0000","last_peered":"2024-04-26T18:06:31.943358+0000","last_clean":"2024-04-26T18:06:31.943358+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:06:31.943358+0000","last_undegraded":"2024-04-26T18:06:31.943358+0000","last_fullsized":"2024-04-26T18:06:31.943358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:06.941024+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T18:06:06.941024+0000","last_peered":"2024-04-26T18:06:06.941024+0000","last_clean":"2024-04-26T18:06:06.941024+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:06:06.941024+0000","last_undegraded":"2024-04-26T18:06:06.941024+0000","last_fullsized":"2024-04-26T18:06:06.941024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.315128+0000","last_change":"2024-04-26T18:03:24.635471+0000","last_active":"2024-04-26T18:08:26.315128+0000","last_peered":"2024-04-26T18:08:26.315128+0000","last_clean":"2024-04-26T18:08:26.315128+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:26.315128+0000","last_undegraded":"2024-04-26T18:08:26.315128+0000","last_fullsized":"2024-04-26T18:08:26.315128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:03.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933106+0000","last_change":"2024-04-26T18:03:24.944311+0000","last_active":"2024-04-26T18:05:01.933106+0000","last_peered":"2024-04-26T18:05:01.933106+0000","last_clean":"2024-04-26T18:05:01.933106+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:05:01.933106+0000","last_undegraded":"2024-04-26T18:05:01.933106+0000","last_fullsized":"2024-04-26T18:05:01.933106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:11.446948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'339","reported_seq":389,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.895454+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T18:08:18.895454+0000","last_peered":"2024-04-26T18:08:18.895454+0000","last_clean":"2024-04-26T18:08:18.895454+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:18.895454+0000","last_undegraded":"2024-04-26T18:08:18.895454+0000","last_fullsized":"2024-04-26T18:08:18.895454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2790,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.275515+0000","last_change":"2024-04-26T18:03:24.636889+0000","last_active":"2024-04-26T18:08:26.275515+0000","last_peered":"2024-04-26T18:08:26.275515+0000","last_clean":"2024-04-26T18:08:26.275515+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:26.275515+0000","last_undegraded":"2024-04-26T18:08:26.275515+0000","last_fullsized":"2024-04-26T18:08:26.275515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:57.257654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'90","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933112+0000","last_change":"2024-04-26T18:03:24.642373+0000","last_active":"2024-04-26T18:05:01.933112+0000","last_peered":"2024-04-26T18:05:01.933112+0000","last_clean":"2024-04-26T18:05:01.933112+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:05:01.933112+0000","last_undegraded":"2024-04-26T18:05:01.933112+0000","last_fullsized":"2024-04-26T18:05:01.933112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:50.494058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'11","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.319192+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T18:08:23.319192+0000","last_peered":"2024-04-26T18:08:23.319192+0000","last_clean":"2024-04-26T18:08:23.319192+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:23.319192+0000","last_undegraded":"2024-04-26T18:08:23.319192+0000","last_fullsized":"2024-04-26T18:08:23.319192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.339174+0000","last_change":"2024-04-26T18:03:25.011325+0000","last_active":"2024-04-26T18:08:26.339174+0000","last_peered":"2024-04-26T18:08:26.339174+0000","last_clean":"2024-04-26T18:08:26.339174+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:26.339174+0000","last_undegraded":"2024-04-26T18:08:26.339174+0000","last_fullsized":"2024-04-26T18:08:26.339174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:28.586899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933183+0000","last_change":"2024-04-26T18:03:24.946369+0000","last_active":"2024-04-26T18:05:01.933183+0000","last_peered":"2024-04-26T18:05:01.933183+0000","last_clean":"2024-04-26T18:05:01.933183+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:05:01.933183+0000","last_undegraded":"2024-04-26T18:05:01.933183+0000","last_fullsized":"2024-04-26T18:05:01.933183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.852091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'114","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.484515+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T18:08:18.484515+0000","last_peered":"2024-04-26T18:08:18.484515+0000","last_clean":"2024-04-26T18:08:18.484515+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:18.484515+0000","last_undegraded":"2024-04-26T18:08:18.484515+0000","last_fullsized":"2024-04-26T18:08:18.484515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.245217+0000","last_change":"2024-04-26T18:03:24.635236+0000","last_active":"2024-04-26T18:08:26.245217+0000","last_peered":"2024-04-26T18:08:26.245217+0000","last_clean":"2024-04-26T18:08:26.245217+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:26.245217+0000","last_undegraded":"2024-04-26T18:08:26.245217+0000","last_fullsized":"2024-04-26T18:08:26.245217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:48.980355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'61","reported_seq":2130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933163+0000","last_change":"2024-04-26T18:03:24.944998+0000","last_active":"2024-04-26T18:05:01.933163+0000","last_peered":"2024-04-26T18:05:01.933163+0000","last_clean":"2024-04-26T18:05:01.933163+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:05:01.933163+0000","last_undegraded":"2024-04-26T18:05:01.933163+0000","last_fullsized":"2024-04-26T18:05:01.933163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:30.416363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'61","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.756283+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T18:06:59.756283+0000","last_peered":"2024-04-26T18:06:59.756283+0000","last_clean":"2024-04-26T18:06:59.756283+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:06:59.756283+0000","last_undegraded":"2024-04-26T18:06:59.756283+0000","last_fullsized":"2024-04-26T18:06:59.756283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2819,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.652003+0000","last_change":"2024-04-26T18:03:24.655394+0000","last_active":"2024-04-26T18:08:26.652003+0000","last_peered":"2024-04-26T18:08:26.652003+0000","last_clean":"2024-04-26T18:08:26.652003+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:26.652003+0000","last_undegraded":"2024-04-26T18:08:26.652003+0000","last_fullsized":"2024-04-26T18:08:26.652003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:04.461317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934805+0000","last_change":"2024-04-26T18:03:24.943633+0000","last_active":"2024-04-26T18:05:16.934805+0000","last_peered":"2024-04-26T18:05:16.934805+0000","last_clean":"2024-04-26T18:05:16.934805+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:05:16.934805+0000","last_undegraded":"2024-04-26T18:05:16.934805+0000","last_fullsized":"2024-04-26T18:05:16.934805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:39.290525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949117+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T18:07:31.949117+0000","last_peered":"2024-04-26T18:07:31.949117+0000","last_clean":"2024-04-26T18:07:31.949117+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:07:31.949117+0000","last_undegraded":"2024-04-26T18:07:31.949117+0000","last_fullsized":"2024-04-26T18:07:31.949117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2765,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.500056+0000","last_change":"2024-04-26T18:03:25.006200+0000","last_active":"2024-04-26T18:08:26.500056+0000","last_peered":"2024-04-26T18:08:26.500056+0000","last_clean":"2024-04-26T18:08:26.500056+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:26.500056+0000","last_undegraded":"2024-04-26T18:08:26.500056+0000","last_fullsized":"2024-04-26T18:08:26.500056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:04.984283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903544+0000","last_change":"2024-04-26T18:03:24.636576+0000","last_active":"2024-04-26T18:06:10.903544+0000","last_peered":"2024-04-26T18:06:10.903544+0000","last_clean":"2024-04-26T18:06:10.903544+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:06:10.903544+0000","last_undegraded":"2024-04-26T18:06:10.903544+0000","last_fullsized":"2024-04-26T18:06:10.903544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:01.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949842+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T18:07:31.949842+0000","last_peered":"2024-04-26T18:07:31.949842+0000","last_clean":"2024-04-26T18:07:31.949842+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:07:31.949842+0000","last_undegraded":"2024-04-26T18:07:31.949842+0000","last_fullsized":"2024-04-26T18:07:31.949842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2757,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656750+0000","last_change":"2024-04-26T18:03:24.989125+0000","last_active":"2024-04-26T18:08:26.656750+0000","last_peered":"2024-04-26T18:08:26.656750+0000","last_clean":"2024-04-26T18:08:26.656750+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:26.656750+0000","last_undegraded":"2024-04-26T18:08:26.656750+0000","last_fullsized":"2024-04-26T18:08:26.656750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:28.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934828+0000","last_change":"2024-04-26T18:03:24.926906+0000","last_active":"2024-04-26T18:05:16.934828+0000","last_peered":"2024-04-26T18:05:16.934828+0000","last_clean":"2024-04-26T18:05:16.934828+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:05:16.934828+0000","last_undegraded":"2024-04-26T18:05:16.934828+0000","last_fullsized":"2024-04-26T18:05:16.934828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:00.232054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:11.934972+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T18:05:11.934972+0000","last_peered":"2024-04-26T18:05:11.934972+0000","last_clean":"2024-04-26T18:05:11.934972+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:05:11.934972+0000","last_undegraded":"2024-04-26T18:05:11.934972+0000","last_fullsized":"2024-04-26T18:05:11.934972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2700,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.659323+0000","last_change":"2024-04-26T18:03:24.996245+0000","last_active":"2024-04-26T18:08:26.659323+0000","last_peered":"2024-04-26T18:08:26.659323+0000","last_clean":"2024-04-26T18:08:26.659323+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:26.659323+0000","last_undegraded":"2024-04-26T18:08:26.659323+0000","last_fullsized":"2024-04-26T18:08:26.659323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:47.633142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'76","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935691+0000","last_change":"2024-04-26T18:03:25.010829+0000","last_active":"2024-04-26T18:05:16.935691+0000","last_peered":"2024-04-26T18:05:16.935691+0000","last_clean":"2024-04-26T18:05:16.935691+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:05:16.935691+0000","last_undegraded":"2024-04-26T18:05:16.935691+0000","last_fullsized":"2024-04-26T18:05:16.935691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:43.796963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949215+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T18:07:31.949215+0000","last_peered":"2024-04-26T18:07:31.949215+0000","last_clean":"2024-04-26T18:07:31.949215+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:07:31.949215+0000","last_undegraded":"2024-04-26T18:07:31.949215+0000","last_fullsized":"2024-04-26T18:07:31.949215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2749,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.079545+0000","last_change":"2024-04-26T18:03:24.641376+0000","last_active":"2024-04-26T18:08:26.079545+0000","last_peered":"2024-04-26T18:08:26.079545+0000","last_clean":"2024-04-26T18:08:26.079545+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:26.079545+0000","last_undegraded":"2024-04-26T18:08:26.079545+0000","last_fullsized":"2024-04-26T18:08:26.079545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.839796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936646+0000","last_change":"2024-04-26T18:03:24.944051+0000","last_active":"2024-04-26T18:05:31.936646+0000","last_peered":"2024-04-26T18:05:31.936646+0000","last_clean":"2024-04-26T18:05:31.936646+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:05:31.936646+0000","last_undegraded":"2024-04-26T18:05:31.936646+0000","last_fullsized":"2024-04-26T18:05:31.936646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:10.353238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'158","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:22.301921+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T18:08:22.301921+0000","last_peered":"2024-04-26T18:08:22.301921+0000","last_clean":"2024-04-26T18:08:22.301921+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:22.301921+0000","last_undegraded":"2024-04-26T18:08:22.301921+0000","last_fullsized":"2024-04-26T18:08:22.301921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.519720+0000","last_change":"2024-04-26T18:03:24.748793+0000","last_active":"2024-04-26T18:08:26.519720+0000","last_peered":"2024-04-26T18:08:26.519720+0000","last_clean":"2024-04-26T18:08:26.519720+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:26.519720+0000","last_undegraded":"2024-04-26T18:08:26.519720+0000","last_fullsized":"2024-04-26T18:08:26.519720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.947294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903472+0000","last_change":"2024-04-26T18:03:24.657577+0000","last_active":"2024-04-26T18:06:10.903472+0000","last_peered":"2024-04-26T18:06:10.903472+0000","last_clean":"2024-04-26T18:06:10.903472+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:06:10.903472+0000","last_undegraded":"2024-04-26T18:06:10.903472+0000","last_fullsized":"2024-04-26T18:06:10.903472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:58.858205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'332","reported_seq":382,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:01.892123+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T18:08:01.892123+0000","last_peered":"2024-04-26T18:08:01.892123+0000","last_clean":"2024-04-26T18:08:01.892123+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:01.892123+0000","last_undegraded":"2024-04-26T18:08:01.892123+0000","last_fullsized":"2024-04-26T18:08:01.892123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.664399+0000","last_change":"2024-04-26T18:03:24.657947+0000","last_active":"2024-04-26T18:08:26.664399+0000","last_peered":"2024-04-26T18:08:26.664399+0000","last_clean":"2024-04-26T18:08:26.664399+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:26.664399+0000","last_undegraded":"2024-04-26T18:08:26.664399+0000","last_fullsized":"2024-04-26T18:08:26.664399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:26.337195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937139+0000","last_change":"2024-04-26T18:03:25.007674+0000","last_active":"2024-04-26T18:05:31.937139+0000","last_peered":"2024-04-26T18:05:31.937139+0000","last_clean":"2024-04-26T18:05:31.937139+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:05:31.937139+0000","last_undegraded":"2024-04-26T18:05:31.937139+0000","last_fullsized":"2024-04-26T18:05:31.937139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:01.233904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'591","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602792+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T18:08:19.602792+0000","last_peered":"2024-04-26T18:08:19.602792+0000","last_clean":"2024-04-26T18:08:19.602792+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:19.602792+0000","last_undegraded":"2024-04-26T18:08:19.602792+0000","last_fullsized":"2024-04-26T18:08:19.602792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2807,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.680572+0000","last_change":"2024-04-26T18:03:24.997268+0000","last_active":"2024-04-26T18:08:26.680572+0000","last_peered":"2024-04-26T18:08:26.680572+0000","last_clean":"2024-04-26T18:08:26.680572+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:26.680572+0000","last_undegraded":"2024-04-26T18:08:26.680572+0000","last_fullsized":"2024-04-26T18:08:26.680572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:53.318883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"34'95","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:46.925955+0000","last_change":"2024-04-26T18:03:24.849449+0000","last_active":"2024-04-26T18:03:46.925955+0000","last_peered":"2024-04-26T18:03:46.925955+0000","last_clean":"2024-04-26T18:03:46.925955+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:03:46.925955+0000","last_undegraded":"2024-04-26T18:03:46.925955+0000","last_fullsized":"2024-04-26T18:03:46.925955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:00.389514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:51.952068+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T18:07:51.952068+0000","last_peered":"2024-04-26T18:07:51.952068+0000","last_clean":"2024-04-26T18:07:51.952068+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:07:51.952068+0000","last_undegraded":"2024-04-26T18:07:51.952068+0000","last_fullsized":"2024-04-26T18:07:51.952068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2805,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.708112+0000","last_change":"2024-04-26T18:03:24.993538+0000","last_active":"2024-04-26T18:08:26.708112+0000","last_peered":"2024-04-26T18:08:26.708112+0000","last_clean":"2024-04-26T18:08:26.708112+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:26.708112+0000","last_undegraded":"2024-04-26T18:08:26.708112+0000","last_fullsized":"2024-04-26T18:08:26.708112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:29.893910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.493317+0000","last_change":"2024-04-26T18:03:25.003948+0000","last_active":"2024-04-26T18:08:26.493317+0000","last_peered":"2024-04-26T18:08:26.493317+0000","last_clean":"2024-04-26T18:08:26.493317+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:26.493317+0000","last_undegraded":"2024-04-26T18:08:26.493317+0000","last_fullsized":"2024-04-26T18:08:26.493317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:07.242676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905320+0000","last_change":"2024-04-26T18:03:24.746669+0000","last_active":"2024-04-26T18:06:10.905320+0000","last_peered":"2024-04-26T18:06:10.905320+0000","last_clean":"2024-04-26T18:06:10.905320+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:06:10.905320+0000","last_undegraded":"2024-04-26T18:06:10.905320+0000","last_fullsized":"2024-04-26T18:06:10.905320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:09.392232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'55","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:24.531223+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T18:08:24.531223+0000","last_peered":"2024-04-26T18:08:24.531223+0000","last_clean":"2024-04-26T18:08:24.531223+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:24.531223+0000","last_undegraded":"2024-04-26T18:08:24.531223+0000","last_fullsized":"2024-04-26T18:08:24.531223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2758,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.433695+0000","last_change":"2024-04-26T18:03:24.635733+0000","last_active":"2024-04-26T18:08:26.433695+0000","last_peered":"2024-04-26T18:08:26.433695+0000","last_clean":"2024-04-26T18:08:26.433695+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:26.433695+0000","last_undegraded":"2024-04-26T18:08:26.433695+0000","last_fullsized":"2024-04-26T18:08:26.433695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:06.120357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'102","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.915184+0000","last_change":"2024-04-26T18:03:24.995053+0000","last_active":"2024-04-26T18:06:37.915184+0000","last_peered":"2024-04-26T18:06:37.915184+0000","last_clean":"2024-04-26T18:06:37.915184+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:06:37.915184+0000","last_undegraded":"2024-04-26T18:06:37.915184+0000","last_fullsized":"2024-04-26T18:06:37.915184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:55.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'26","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:52.001657+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T18:07:52.001657+0000","last_peered":"2024-04-26T18:07:52.001657+0000","last_clean":"2024-04-26T18:07:52.001657+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:07:52.001657+0000","last_undegraded":"2024-04-26T18:07:52.001657+0000","last_fullsized":"2024-04-26T18:07:52.001657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1429","reported_seq":1479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:10.797074+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T18:08:10.797074+0000","last_peered":"2024-04-26T18:08:10.797074+0000","last_clean":"2024-04-26T18:08:10.797074+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:08:10.797074+0000","last_undegraded":"2024-04-26T18:08:10.797074+0000","last_fullsized":"2024-04-26T18:08:10.797074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1429,"log_dups_size":0,"ondisk_log_size":1429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1427,"num_write_kb":17455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938508+0000","last_change":"2024-04-26T18:03:25.011524+0000","last_active":"2024-04-26T18:05:46.938508+0000","last_peered":"2024-04-26T18:05:46.938508+0000","last_clean":"2024-04-26T18:05:46.938508+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:05:46.938508+0000","last_undegraded":"2024-04-26T18:05:46.938508+0000","last_fullsized":"2024-04-26T18:05:46.938508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:37.329300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2733,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.084785+0000","last_change":"2024-04-26T18:03:24.855578+0000","last_active":"2024-04-26T18:08:26.084785+0000","last_peered":"2024-04-26T18:08:26.084785+0000","last_clean":"2024-04-26T18:08:26.084785+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:26.084785+0000","last_undegraded":"2024-04-26T18:08:26.084785+0000","last_fullsized":"2024-04-26T18:08:26.084785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:11.993735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'53","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.720705+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T18:06:45.720705+0000","last_peered":"2024-04-26T18:06:45.720705+0000","last_clean":"2024-04-26T18:06:45.720705+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:06:45.720705+0000","last_undegraded":"2024-04-26T18:06:45.720705+0000","last_fullsized":"2024-04-26T18:06:45.720705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.944631+0000","last_change":"2024-04-26T18:03:24.655256+0000","last_active":"2024-04-26T18:05:46.944631+0000","last_peered":"2024-04-26T18:05:46.944631+0000","last_clean":"2024-04-26T18:05:46.944631+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:05:46.944631+0000","last_undegraded":"2024-04-26T18:05:46.944631+0000","last_fullsized":"2024-04-26T18:05:46.944631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:10.999130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2760,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.582954+0000","last_change":"2024-04-26T18:03:24.995728+0000","last_active":"2024-04-26T18:08:26.582954+0000","last_peered":"2024-04-26T18:08:26.582954+0000","last_clean":"2024-04-26T18:08:26.582954+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:26.582954+0000","last_undegraded":"2024-04-26T18:08:26.582954+0000","last_fullsized":"2024-04-26T18:08:26.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:59.292898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"35'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929463+0000","last_change":"2024-04-26T18:03:24.635879+0000","last_active":"2024-04-26T18:04:31.929463+0000","last_peered":"2024-04-26T18:04:31.929463+0000","last_clean":"2024-04-26T18:04:31.929463+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:04:31.929463+0000","last_undegraded":"2024-04-26T18:04:31.929463+0000","last_fullsized":"2024-04-26T18:04:31.929463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:59.542460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930610+0000","last_change":"2024-04-26T18:03:24.853558+0000","last_active":"2024-04-26T18:04:31.930610+0000","last_peered":"2024-04-26T18:04:31.930610+0000","last_clean":"2024-04-26T18:04:31.930610+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:04:31.930610+0000","last_undegraded":"2024-04-26T18:04:31.930610+0000","last_fullsized":"2024-04-26T18:04:31.930610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:25.997781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'94","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.904089+0000","last_change":"2024-04-26T18:03:24.642154+0000","last_active":"2024-04-26T18:06:10.904089+0000","last_peered":"2024-04-26T18:06:10.904089+0000","last_clean":"2024-04-26T18:06:10.904089+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:06:10.904089+0000","last_undegraded":"2024-04-26T18:06:10.904089+0000","last_fullsized":"2024-04-26T18:06:10.904089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:50.872113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930784+0000","last_change":"2024-04-26T18:03:25.011221+0000","last_active":"2024-04-26T18:04:31.930784+0000","last_peered":"2024-04-26T18:04:31.930784+0000","last_clean":"2024-04-26T18:04:31.930784+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:04:31.930784+0000","last_undegraded":"2024-04-26T18:04:31.930784+0000","last_fullsized":"2024-04-26T18:04:31.930784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:00.133637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932533+0000","last_change":"2024-04-26T18:03:24.996541+0000","last_active":"2024-04-26T18:04:46.932533+0000","last_peered":"2024-04-26T18:04:46.932533+0000","last_clean":"2024-04-26T18:04:46.932533+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:04:46.932533+0000","last_undegraded":"2024-04-26T18:04:46.932533+0000","last_fullsized":"2024-04-26T18:04:46.932533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:21.848231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932437+0000","last_change":"2024-04-26T18:03:24.748158+0000","last_active":"2024-04-26T18:04:46.932437+0000","last_peered":"2024-04-26T18:04:46.932437+0000","last_clean":"2024-04-26T18:04:46.932437+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:04:46.932437+0000","last_undegraded":"2024-04-26T18:04:46.932437+0000","last_fullsized":"2024-04-26T18:04:46.932437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.736661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'94","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931247+0000","last_change":"2024-04-26T18:03:24.637015+0000","last_active":"2024-04-26T18:04:46.931247+0000","last_peered":"2024-04-26T18:04:46.931247+0000","last_clean":"2024-04-26T18:04:46.931247+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:04:46.931247+0000","last_undegraded":"2024-04-26T18:04:46.931247+0000","last_fullsized":"2024-04-26T18:04:46.931247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:53.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"35'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932554+0000","last_change":"2024-04-26T18:03:24.988961+0000","last_active":"2024-04-26T18:04:46.932554+0000","last_peered":"2024-04-26T18:04:46.932554+0000","last_clean":"2024-04-26T18:04:46.932554+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:04:46.932554+0000","last_undegraded":"2024-04-26T18:04:46.932554+0000","last_fullsized":"2024-04-26T18:04:46.932554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:44.663355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'85","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931167+0000","last_change":"2024-04-26T18:03:24.637315+0000","last_active":"2024-04-26T18:04:46.931167+0000","last_peered":"2024-04-26T18:04:46.931167+0000","last_clean":"2024-04-26T18:04:46.931167+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:04:46.931167+0000","last_undegraded":"2024-04-26T18:04:46.931167+0000","last_fullsized":"2024-04-26T18:04:46.931167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:28.067247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934135+0000","last_change":"2024-04-26T18:03:24.989182+0000","last_active":"2024-04-26T18:05:01.934135+0000","last_peered":"2024-04-26T18:05:01.934135+0000","last_clean":"2024-04-26T18:05:01.934135+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:05:01.934135+0000","last_undegraded":"2024-04-26T18:05:01.934135+0000","last_fullsized":"2024-04-26T18:05:01.934135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:40.391182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'85","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:41.937620+0000","last_change":"2024-04-26T18:03:24.852287+0000","last_active":"2024-04-26T18:05:41.937620+0000","last_peered":"2024-04-26T18:05:41.937620+0000","last_clean":"2024-04-26T18:05:41.937620+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:05:41.937620+0000","last_undegraded":"2024-04-26T18:05:41.937620+0000","last_fullsized":"2024-04-26T18:05:41.937620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:31.793462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'79","reported_seq":2148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933958+0000","last_change":"2024-04-26T18:03:25.009931+0000","last_active":"2024-04-26T18:05:01.933958+0000","last_peered":"2024-04-26T18:05:01.933958+0000","last_clean":"2024-04-26T18:05:01.933958+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:05:01.933958+0000","last_undegraded":"2024-04-26T18:05:01.933958+0000","last_fullsized":"2024-04-26T18:05:01.933958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:15.705947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933102+0000","last_change":"2024-04-26T18:03:24.637292+0000","last_active":"2024-04-26T18:05:01.933102+0000","last_peered":"2024-04-26T18:05:01.933102+0000","last_clean":"2024-04-26T18:05:01.933102+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:05:01.933102+0000","last_undegraded":"2024-04-26T18:05:01.933102+0000","last_fullsized":"2024-04-26T18:05:01.933102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:27.406729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933137+0000","last_change":"2024-04-26T18:03:24.944245+0000","last_active":"2024-04-26T18:05:01.933137+0000","last_peered":"2024-04-26T18:05:01.933137+0000","last_clean":"2024-04-26T18:05:01.933137+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:05:01.933137+0000","last_undegraded":"2024-04-26T18:05:01.933137+0000","last_fullsized":"2024-04-26T18:05:01.933137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:06.577309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935431+0000","last_change":"2024-04-26T18:03:24.851534+0000","last_active":"2024-04-26T18:05:16.935431+0000","last_peered":"2024-04-26T18:05:16.935431+0000","last_clean":"2024-04-26T18:05:16.935431+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:05:16.935431+0000","last_undegraded":"2024-04-26T18:05:16.935431+0000","last_fullsized":"2024-04-26T18:05:16.935431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:49.815792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'86","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935510+0000","last_change":"2024-04-26T18:03:24.642437+0000","last_active":"2024-04-26T18:05:16.935510+0000","last_peered":"2024-04-26T18:05:16.935510+0000","last_clean":"2024-04-26T18:05:16.935510+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:05:16.935510+0000","last_undegraded":"2024-04-26T18:05:16.935510+0000","last_fullsized":"2024-04-26T18:05:16.935510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'88","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935454+0000","last_change":"2024-04-26T18:03:24.635610+0000","last_active":"2024-04-26T18:05:16.935454+0000","last_peered":"2024-04-26T18:05:16.935454+0000","last_clean":"2024-04-26T18:05:16.935454+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:05:16.935454+0000","last_undegraded":"2024-04-26T18:05:16.935454+0000","last_fullsized":"2024-04-26T18:05:16.935454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:01.517984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.936205+0000","last_change":"2024-04-26T18:03:24.746082+0000","last_active":"2024-04-26T18:05:16.936205+0000","last_peered":"2024-04-26T18:05:16.936205+0000","last_clean":"2024-04-26T18:05:16.936205+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:05:16.936205+0000","last_undegraded":"2024-04-26T18:05:16.936205+0000","last_fullsized":"2024-04-26T18:05:16.936205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:01.306469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935675+0000","last_change":"2024-04-26T18:03:25.011535+0000","last_active":"2024-04-26T18:05:16.935675+0000","last_peered":"2024-04-26T18:05:16.935675+0000","last_clean":"2024-04-26T18:05:16.935675+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:05:16.935675+0000","last_undegraded":"2024-04-26T18:05:16.935675+0000","last_fullsized":"2024-04-26T18:05:16.935675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:59.943859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.938476+0000","last_change":"2024-04-26T18:03:24.968688+0000","last_active":"2024-04-26T18:05:31.938476+0000","last_peered":"2024-04-26T18:05:31.938476+0000","last_clean":"2024-04-26T18:05:31.938476+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:05:31.938476+0000","last_undegraded":"2024-04-26T18:05:31.938476+0000","last_fullsized":"2024-04-26T18:05:31.938476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:44.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"34'69","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.943075+0000","last_change":"2024-04-26T18:03:24.656824+0000","last_active":"2024-04-26T18:05:31.943075+0000","last_peered":"2024-04-26T18:05:31.943075+0000","last_clean":"2024-04-26T18:05:31.943075+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:05:31.943075+0000","last_undegraded":"2024-04-26T18:05:31.943075+0000","last_fullsized":"2024-04-26T18:05:31.943075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:16.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903023+0000","last_change":"2024-04-26T18:03:24.634849+0000","last_active":"2024-04-26T18:06:10.903023+0000","last_peered":"2024-04-26T18:06:10.903023+0000","last_clean":"2024-04-26T18:06:10.903023+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:06:10.903023+0000","last_undegraded":"2024-04-26T18:06:10.903023+0000","last_fullsized":"2024-04-26T18:06:10.903023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.994234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937001+0000","last_change":"2024-04-26T18:03:24.636282+0000","last_active":"2024-04-26T18:05:31.937001+0000","last_peered":"2024-04-26T18:05:31.937001+0000","last_clean":"2024-04-26T18:05:31.937001+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:05:31.937001+0000","last_undegraded":"2024-04-26T18:05:31.937001+0000","last_fullsized":"2024-04-26T18:05:31.937001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:07.014169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'73","reported_seq":2142,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936681+0000","last_change":"2024-04-26T18:03:24.946554+0000","last_active":"2024-04-26T18:05:31.936681+0000","last_peered":"2024-04-26T18:05:31.936681+0000","last_clean":"2024-04-26T18:05:31.936681+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:05:31.936681+0000","last_undegraded":"2024-04-26T18:05:31.936681+0000","last_fullsized":"2024-04-26T18:05:31.936681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:44.578641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"34'65","reported_seq":2134,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.939780+0000","last_change":"2024-04-26T18:03:24.995186+0000","last_active":"2024-04-26T18:05:46.939780+0000","last_peered":"2024-04-26T18:05:46.939780+0000","last_clean":"2024-04-26T18:05:46.939780+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:05:46.939780+0000","last_undegraded":"2024-04-26T18:05:46.939780+0000","last_fullsized":"2024-04-26T18:05:46.939780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:02.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'99","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938480+0000","last_change":"2024-04-26T18:03:24.942130+0000","last_active":"2024-04-26T18:05:46.938480+0000","last_peered":"2024-04-26T18:05:46.938480+0000","last_clean":"2024-04-26T18:05:46.938480+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:05:46.938480+0000","last_undegraded":"2024-04-26T18:05:46.938480+0000","last_fullsized":"2024-04-26T18:05:46.938480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:58.029188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'86","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:56.926877+0000","last_change":"2024-04-26T18:03:24.852029+0000","last_active":"2024-04-26T18:03:56.926877+0000","last_peered":"2024-04-26T18:03:56.926877+0000","last_clean":"2024-04-26T18:03:56.926877+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:03:56.926877+0000","last_undegraded":"2024-04-26T18:03:56.926877+0000","last_fullsized":"2024-04-26T18:03:56.926877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:23.464299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938521+0000","last_change":"2024-04-26T18:03:24.932964+0000","last_active":"2024-04-26T18:05:46.938521+0000","last_peered":"2024-04-26T18:05:46.938521+0000","last_clean":"2024-04-26T18:05:46.938521+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:05:46.938521+0000","last_undegraded":"2024-04-26T18:05:46.938521+0000","last_fullsized":"2024-04-26T18:05:46.938521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:24.157039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941580+0000","last_change":"2024-04-26T18:03:24.641802+0000","last_active":"2024-04-26T18:06:16.941580+0000","last_peered":"2024-04-26T18:06:16.941580+0000","last_clean":"2024-04-26T18:06:16.941580+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:06:16.941580+0000","last_undegraded":"2024-04-26T18:06:16.941580+0000","last_fullsized":"2024-04-26T18:06:16.941580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:18:40.921369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930799+0000","last_change":"2024-04-26T18:03:25.004919+0000","last_active":"2024-04-26T18:04:31.930799+0000","last_peered":"2024-04-26T18:04:31.930799+0000","last_clean":"2024-04-26T18:04:31.930799+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:04:31.930799+0000","last_undegraded":"2024-04-26T18:04:31.930799+0000","last_fullsized":"2024-04-26T18:04:31.930799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:52.306796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:42.865142+0000","last_change":"2024-04-26T18:03:24.745389+0000","last_active":"2024-04-26T18:04:42.865142+0000","last_peered":"2024-04-26T18:04:42.865142+0000","last_clean":"2024-04-26T18:04:42.865142+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:04:42.865142+0000","last_undegraded":"2024-04-26T18:04:42.865142+0000","last_fullsized":"2024-04-26T18:04:42.865142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:12.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929496+0000","last_change":"2024-04-26T18:03:24.945776+0000","last_active":"2024-04-26T18:04:31.929496+0000","last_peered":"2024-04-26T18:04:31.929496+0000","last_clean":"2024-04-26T18:04:31.929496+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:04:31.929496+0000","last_undegraded":"2024-04-26T18:04:31.929496+0000","last_fullsized":"2024-04-26T18:04:31.929496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:13.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5276,"ondisk_log_size":5276,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":227070368,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8619,"num_write_kb":230563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454197248,"data_stored":454140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8258,"ondisk_log_size":8258,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":285960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":292823040,"data_stored":292603949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441680,"kb_used_data":330056,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93930160,"statfs":{"total":96636764160,"available":96184483840,"internally_reserved":0,"allocated":337977344,"data_stored":337757799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336168,"kb_used_data":255008,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94035672,"statfs":{"total":96636764160,"available":96292528128,"internally_reserved":0,"allocated":261128192,"data_stored":260910302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416472,"kb_used_data":304784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93955368,"statfs":{"total":96636764160,"available":96210296832,"internally_reserved":0,"allocated":312098816,"data_stored":311872770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514900,"kb_used_data":389324,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":93856940,"statfs":{"total":96636764160,"available":96109506560,"internally_reserved":0,"allocated":398667776,"data_stored":398447177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273200,"kb_used_data":197608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94098640,"statfs":{"total":96636764160,"available":96357007360,"internally_reserved":0,"allocated":202350592,"data_stored":202137513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481284,"kb_used_data":369596,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93890556,"statfs":{"total":96636764160,"available":96143929344,"internally_reserved":0,"allocated":378466304,"data_stored":378246247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349180,"kb_used_data":255540,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94022660,"statfs":{"total":96636764160,"available":96279203840,"internally_reserved":0,"allocated":261672960,"data_stored":261445733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58728448,"data_stored":58720416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46723072,"data_stored":46714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62918656,"data_stored":62914650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71311360,"data_stored":71303840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:08:29.942 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T18:08:29.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:08:30.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.077+0000 7f3038ac8640 1 Processor -- start 2024-04-26T18:08:30.078 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.077+0000 7f3038ac8640 1 -- start start 2024-04-26T18:08:30.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3038ac8640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f30340b4370 0x7f303415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3038ac8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303415fa00 con 0x7f30340ce450 2024-04-26T18:08:30.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3038ac8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303415fce0 con 0x7f30340ce070 2024-04-26T18:08:30.079 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3038ac8640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f30340cc090 con 0x7f30340b4370 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3031d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f30340b4370 0x7f303415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3032d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f30340ce450 0x7f30340ccae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46590/0 (socket says 172.21.15.12:46590) 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3032d9d640 1 -- 172.21.15.12:0/3542746233 learned_addr learned my addr 172.21.15.12:0/3542746233 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.078+0000 7f3031d9b640 1 --2- 172.21.15.12:0/3542746233 >> v2:172.21.15.12:3300/0 conn(0x7f30340b4370 0x7f303415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41224/0 (socket says 172.21.15.12:41224) 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.079+0000 7f3031d9b640 1 -- 172.21.15.12:0/3542746233 >> v1:172.21.15.100:6789/0 conn(0x7f30340ce070 legacy=0x7f303415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.079+0000 7f3031d9b640 1 -- 172.21.15.12:0/3542746233 >> v1:172.21.15.12:6789/0 conn(0x7f30340ce450 legacy=0x7f30340ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.080 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.079+0000 7f3031d9b640 1 -- 172.21.15.12:0/3542746233 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303415ffc0 con 0x7f30340b4370 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.079+0000 7f3031d9b640 1 --2- 172.21.15.12:0/3542746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340b4370 0x7f303415bbd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f30340cc210 tx=0x7f301c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2835cbd326da9089 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f303159a640 1 -- 172.21.15.12:0/3542746233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c037070 con 0x7f30340b4370 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f303159a640 1 -- 172.21.15.12:0/3542746233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c032440 con 0x7f30340b4370 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f303159a640 1 -- 172.21.15.12:0/3542746233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c032810 con 0x7f30340b4370 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 -- 172.21.15.12:0/3542746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340b4370 msgr2=0x7f303415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.084 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 --2- 172.21.15.12:0/3542746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340b4370 0x7f303415bbd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f30340cc210 tx=0x7f301c02a180 comp rx=0 tx=0).stop 2024-04-26T18:08:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 -- 172.21.15.12:0/3542746233 shutdown_connections 2024-04-26T18:08:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 --2- 172.21.15.12:0/3542746233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340b4370 0x7f303415bbd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.085 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 -- 172.21.15.12:0/3542746233 >> 172.21.15.12:0/3542746233 conn(0x7f30340743c0 msgr2=0x7f3034068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 -- 172.21.15.12:0/3542746233 shutdown_connections 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.080+0000 7f3038ac8640 1 -- 172.21.15.12:0/3542746233 wait complete. 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 Processor -- start 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 -- start start 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 0x7f30340cf500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f30340ce450 0x7f3034152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.086 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f30340cd1f0 con 0x7f30340ce070 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f30340cc5c0 con 0x7f30340b4370 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3038ac8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f30340cd370 con 0x7f30340ce450 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3031d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3031d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41228/0 (socket says 172.21.15.12:41228) 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.082+0000 7f3031d9b640 1 -- 172.21.15.12:0/1662026494 learned_addr learned my addr 172.21.15.12:0/1662026494 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f303259c640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 0x7f30340cf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3032d9d640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f30340ce450 0x7f3034152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 -- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f30340ce450 msgr2=0x7f3034152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f30340ce450 0x7f3034152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 -- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 msgr2=0x7f30340cf500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 0x7f30340cf500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 -- 172.21.15.12:0/1662026494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30341511e0 con 0x7f30340ce070 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f303259c640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 0x7f30340cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3031d9b640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f301c009890 tx=0x7f301c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c037040 con 0x7f30340ce070 2024-04-26T18:08:30.088 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c042070 con 0x7f30340ce070 2024-04-26T18:08:30.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3034150dc0 con 0x7f30340ce070 2024-04-26T18:08:30.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c030a50 con 0x7f30340ce070 2024-04-26T18:08:30.089 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.083+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3034151450 con 0x7f30340ce070 2024-04-26T18:08:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.084+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30340b4d30 con 0x7f30340ce070 2024-04-26T18:08:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.085+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f301c030bf0 con 0x7f30340ce070 2024-04-26T18:08:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.085+0000 7f302affd640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.090 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.085+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f301c0ac9c0 con 0x7f30340ce070 2024-04-26T18:08:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.085+0000 7f303259c640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.086+0000 7f303259c640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f302c001700 tx=0x7f302c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.091 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.090+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f30340b4d30 con 0x7f30340ce070 2024-04-26T18:08:30.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.274+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3034076d20 con 0x7f301406c8f0 2024-04-26T18:08:30.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.283+0000 7f302affd640 1 -- 172.21.15.12:0/1662026494 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336583 (secure 0 0 0) 0x7f3034076d20 con 0x7f301406c8f0 2024-04-26T18:08:30.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 msgr2=0x7f301406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f302c001700 tx=0x7f302c009040 comp rx=0 tx=0).stop 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 msgr2=0x7f3034152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f301c009890 tx=0x7f301c0046c0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 shutdown_connections 2024-04-26T18:08:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f30340ce450 0x7f3034152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30340ce070 0x7f3034152210 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 --2- 172.21.15.12:0/1662026494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f30340b4370 0x7f30340cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.286+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 >> 172.21.15.12:0/1662026494 conn(0x7f30340743c0 msgr2=0x7f30340c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.287+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 shutdown_connections 2024-04-26T18:08:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.287+0000 7f3038ac8640 1 -- 172.21.15.12:0/1662026494 wait complete. 2024-04-26T18:08:30.298 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-04-26T18:08:30.034446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1177407960,"num_objects":10787,"num_object_clones":0,"num_object_copies":42846,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10787,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30231,"num_write_kb":1777170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35133,"ondisk_log_size":35133,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3184164,"kb_used_data":2387876,"kb_used_omap":12,"kb_used_meta":796211,"kb_avail":751790556,"statfs":{"total":773094113280,"available":769833529344,"internally_reserved":0,"allocated":2445185024,"data_stored":2443421490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":815320624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44265972,"num_objects":2488,"num_object_clones":0,"num_object_copies":9896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2488,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2681,"num_write_kb":45260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":24,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003625"},"pg_stats":[{"pgid":"2.1f","version":"36'123","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655962+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T18:06:59.655962+0000","last_peered":"2024-04-26T18:06:59.655962+0000","last_clean":"2024-04-26T18:06:59.655962+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:06:59.655962+0000","last_undegraded":"2024-04-26T18:06:59.655962+0000","last_fullsized":"2024-04-26T18:06:59.655962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"34'87","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.943078+0000","last_change":"2024-04-26T18:03:24.967895+0000","last_active":"2024-04-26T18:06:16.943078+0000","last_peered":"2024-04-26T18:06:16.943078+0000","last_clean":"2024-04-26T18:06:16.943078+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:06:16.943078+0000","last_undegraded":"2024-04-26T18:06:16.943078+0000","last_fullsized":"2024-04-26T18:06:16.943078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:40.112811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.700846+0000","last_change":"2024-04-26T18:03:24.991152+0000","last_active":"2024-04-26T18:08:26.700846+0000","last_peered":"2024-04-26T18:08:26.700846+0000","last_clean":"2024-04-26T18:08:26.700846+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:26.700846+0000","last_undegraded":"2024-04-26T18:08:26.700846+0000","last_fullsized":"2024-04-26T18:08:26.700846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:03.026992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1624","reported_seq":1675,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.655650+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T18:08:19.655650+0000","last_peered":"2024-04-26T18:08:19.655650+0000","last_clean":"2024-04-26T18:08:19.655650+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:19.655650+0000","last_undegraded":"2024-04-26T18:08:19.655650+0000","last_fullsized":"2024-04-26T18:08:19.655650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930816+0000","last_change":"2024-04-26T18:03:25.006390+0000","last_active":"2024-04-26T18:04:31.930816+0000","last_peered":"2024-04-26T18:04:31.930816+0000","last_clean":"2024-04-26T18:04:31.930816+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:04:31.930816+0000","last_undegraded":"2024-04-26T18:04:31.930816+0000","last_fullsized":"2024-04-26T18:04:31.930816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:42.430689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2789,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678592+0000","last_change":"2024-04-26T18:03:24.654455+0000","last_active":"2024-04-26T18:08:26.678592+0000","last_peered":"2024-04-26T18:08:26.678592+0000","last_clean":"2024-04-26T18:08:26.678592+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:26.678592+0000","last_undegraded":"2024-04-26T18:08:26.678592+0000","last_fullsized":"2024-04-26T18:08:26.678592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.834932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'722","reported_seq":772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372121+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T18:08:14.372121+0000","last_peered":"2024-04-26T18:08:14.372121+0000","last_clean":"2024-04-26T18:08:14.372121+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:14.372121+0000","last_undegraded":"2024-04-26T18:08:14.372121+0000","last_fullsized":"2024-04-26T18:08:14.372121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'82","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938591+0000","last_change":"2024-04-26T18:03:24.642146+0000","last_active":"2024-04-26T18:05:46.938591+0000","last_peered":"2024-04-26T18:05:46.938591+0000","last_clean":"2024-04-26T18:05:46.938591+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:05:46.938591+0000","last_undegraded":"2024-04-26T18:05:46.938591+0000","last_fullsized":"2024-04-26T18:05:46.938591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:42.065227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678605+0000","last_change":"2024-04-26T18:03:24.657679+0000","last_active":"2024-04-26T18:08:26.678605+0000","last_peered":"2024-04-26T18:08:26.678605+0000","last_clean":"2024-04-26T18:08:26.678605+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:26.678605+0000","last_undegraded":"2024-04-26T18:08:26.678605+0000","last_fullsized":"2024-04-26T18:08:26.678605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:45.442811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'165","reported_seq":215,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.603071+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T18:08:19.603071+0000","last_peered":"2024-04-26T18:08:19.603071+0000","last_clean":"2024-04-26T18:08:19.603071+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:19.603071+0000","last_undegraded":"2024-04-26T18:08:19.603071+0000","last_fullsized":"2024-04-26T18:08:19.603071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'75","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:38.915794+0000","last_change":"2024-04-26T18:03:24.641061+0000","last_active":"2024-04-26T18:06:38.915794+0000","last_peered":"2024-04-26T18:06:38.915794+0000","last_clean":"2024-04-26T18:06:38.915794+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:06:38.915794+0000","last_undegraded":"2024-04-26T18:06:38.915794+0000","last_fullsized":"2024-04-26T18:06:38.915794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:45.214146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494273+0000","last_change":"2024-04-26T18:03:24.655979+0000","last_active":"2024-04-26T18:08:26.494273+0000","last_peered":"2024-04-26T18:08:26.494273+0000","last_clean":"2024-04-26T18:08:26.494273+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:26.494273+0000","last_undegraded":"2024-04-26T18:08:26.494273+0000","last_fullsized":"2024-04-26T18:08:26.494273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:20.235120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931210+0000","last_change":"2024-04-26T18:03:24.635966+0000","last_active":"2024-04-26T18:04:46.931210+0000","last_peered":"2024-04-26T18:04:46.931210+0000","last_clean":"2024-04-26T18:04:46.931210+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:04:46.931210+0000","last_undegraded":"2024-04-26T18:04:46.931210+0000","last_fullsized":"2024-04-26T18:04:46.931210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:08.113204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'224","reported_seq":274,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655859+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T18:06:59.655859+0000","last_peered":"2024-04-26T18:06:59.655859+0000","last_clean":"2024-04-26T18:06:59.655859+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:06:59.655859+0000","last_undegraded":"2024-04-26T18:06:59.655859+0000","last_fullsized":"2024-04-26T18:06:59.655859+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656882+0000","last_change":"2024-04-26T18:03:24.657047+0000","last_active":"2024-04-26T18:08:26.656882+0000","last_peered":"2024-04-26T18:08:26.656882+0000","last_clean":"2024-04-26T18:08:26.656882+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:26.656882+0000","last_undegraded":"2024-04-26T18:08:26.656882+0000","last_fullsized":"2024-04-26T18:08:26.656882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:12.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934167+0000","last_change":"2024-04-26T18:03:24.972452+0000","last_active":"2024-04-26T18:05:01.934167+0000","last_peered":"2024-04-26T18:05:01.934167+0000","last_clean":"2024-04-26T18:05:01.934167+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:05:01.934167+0000","last_undegraded":"2024-04-26T18:05:01.934167+0000","last_fullsized":"2024-04-26T18:05:01.934167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:22.285266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'837","reported_seq":887,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:14.564924+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T18:07:14.564924+0000","last_peered":"2024-04-26T18:07:14.564924+0000","last_clean":"2024-04-26T18:07:14.564924+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:07:14.564924+0000","last_undegraded":"2024-04-26T18:07:14.564924+0000","last_fullsized":"2024-04-26T18:07:14.564924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":837,"log_dups_size":0,"ondisk_log_size":837,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":8790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.491409+0000","last_change":"2024-04-26T18:03:24.656810+0000","last_active":"2024-04-26T18:08:26.491409+0000","last_peered":"2024-04-26T18:08:26.491409+0000","last_clean":"2024-04-26T18:08:26.491409+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:26.491409+0000","last_undegraded":"2024-04-26T18:08:26.491409+0000","last_fullsized":"2024-04-26T18:08:26.491409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:58.022914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905447+0000","last_change":"2024-04-26T18:03:24.996978+0000","last_active":"2024-04-26T18:06:10.905447+0000","last_peered":"2024-04-26T18:06:10.905447+0000","last_clean":"2024-04-26T18:06:10.905447+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:06:10.905447+0000","last_undegraded":"2024-04-26T18:06:10.905447+0000","last_fullsized":"2024-04-26T18:06:10.905447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.166776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'70","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372832+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T18:08:14.372832+0000","last_peered":"2024-04-26T18:08:14.372832+0000","last_clean":"2024-04-26T18:08:14.372832+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:14.372832+0000","last_undegraded":"2024-04-26T18:08:14.372832+0000","last_fullsized":"2024-04-26T18:08:14.372832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2794,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640445+0000","last_change":"2024-04-26T18:03:24.748206+0000","last_active":"2024-04-26T18:08:26.640445+0000","last_peered":"2024-04-26T18:08:26.640445+0000","last_clean":"2024-04-26T18:08:26.640445+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:26.640445+0000","last_undegraded":"2024-04-26T18:08:26.640445+0000","last_fullsized":"2024-04-26T18:08:26.640445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:03.632839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'91","reported_seq":2160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.937288+0000","last_change":"2024-04-26T18:03:24.656039+0000","last_active":"2024-04-26T18:04:46.937288+0000","last_peered":"2024-04-26T18:04:46.937288+0000","last_clean":"2024-04-26T18:04:46.937288+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:04:46.937288+0000","last_undegraded":"2024-04-26T18:04:46.937288+0000","last_fullsized":"2024-04-26T18:04:46.937288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:46.594712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'7","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.755314+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T18:06:59.755314+0000","last_peered":"2024-04-26T18:06:59.755314+0000","last_clean":"2024-04-26T18:06:59.755314+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:06:59.755314+0000","last_undegraded":"2024-04-26T18:06:59.755314+0000","last_fullsized":"2024-04-26T18:06:59.755314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.473190+0000","last_change":"2024-04-26T18:03:24.656487+0000","last_active":"2024-04-26T18:08:26.473190+0000","last_peered":"2024-04-26T18:08:26.473190+0000","last_clean":"2024-04-26T18:08:26.473190+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:26.473190+0000","last_undegraded":"2024-04-26T18:08:26.473190+0000","last_fullsized":"2024-04-26T18:08:26.473190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:09.597061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932205+0000","last_change":"2024-04-26T18:03:25.006124+0000","last_active":"2024-04-26T18:04:46.932205+0000","last_peered":"2024-04-26T18:04:46.932205+0000","last_clean":"2024-04-26T18:04:46.932205+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:04:46.932205+0000","last_undegraded":"2024-04-26T18:04:46.932205+0000","last_fullsized":"2024-04-26T18:04:46.932205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:50.782589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'192","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:41.930694+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T18:04:41.930694+0000","last_peered":"2024-04-26T18:04:41.930694+0000","last_clean":"2024-04-26T18:04:41.930694+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:04:41.930694+0000","last_undegraded":"2024-04-26T18:04:41.930694+0000","last_fullsized":"2024-04-26T18:04:41.930694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2799,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.633174+0000","last_change":"2024-04-26T18:03:24.655017+0000","last_active":"2024-04-26T18:08:26.633174+0000","last_peered":"2024-04-26T18:08:26.633174+0000","last_clean":"2024-04-26T18:08:26.633174+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:26.633174+0000","last_undegraded":"2024-04-26T18:08:26.633174+0000","last_fullsized":"2024-04-26T18:08:26.633174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:34.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'83","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:26.937150+0000","last_change":"2024-04-26T18:03:24.746543+0000","last_active":"2024-04-26T18:05:26.937150+0000","last_peered":"2024-04-26T18:05:26.937150+0000","last_clean":"2024-04-26T18:05:26.937150+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:05:26.937150+0000","last_undegraded":"2024-04-26T18:05:26.937150+0000","last_fullsized":"2024-04-26T18:05:26.937150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:51.534255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'258","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.976486+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T18:08:23.976486+0000","last_peered":"2024-04-26T18:08:23.976486+0000","last_clean":"2024-04-26T18:08:23.976486+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:23.976486+0000","last_undegraded":"2024-04-26T18:08:23.976486+0000","last_fullsized":"2024-04-26T18:08:23.976486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":599,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2829,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.689970+0000","last_change":"2024-04-26T18:03:24.996787+0000","last_active":"2024-04-26T18:08:26.689970+0000","last_peered":"2024-04-26T18:08:26.689970+0000","last_clean":"2024-04-26T18:08:26.689970+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:26.689970+0000","last_undegraded":"2024-04-26T18:08:26.689970+0000","last_fullsized":"2024-04-26T18:08:26.689970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"34'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930926+0000","last_change":"2024-04-26T18:03:24.747226+0000","last_active":"2024-04-26T18:04:31.930926+0000","last_peered":"2024-04-26T18:04:31.930926+0000","last_clean":"2024-04-26T18:04:31.930926+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:04:31.930926+0000","last_undegraded":"2024-04-26T18:04:31.930926+0000","last_fullsized":"2024-04-26T18:04:31.930926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.708780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'145","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.147385+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T18:06:37.147385+0000","last_peered":"2024-04-26T18:06:37.147385+0000","last_clean":"2024-04-26T18:06:37.147385+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:06:37.147385+0000","last_undegraded":"2024-04-26T18:06:37.147385+0000","last_fullsized":"2024-04-26T18:06:37.147385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.331133+0000","last_change":"2024-04-26T18:03:25.011835+0000","last_active":"2024-04-26T18:08:26.331133+0000","last_peered":"2024-04-26T18:08:26.331133+0000","last_clean":"2024-04-26T18:08:26.331133+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:26.331133+0000","last_undegraded":"2024-04-26T18:08:26.331133+0000","last_fullsized":"2024-04-26T18:08:26.331133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.743889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"34'79","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929493+0000","last_change":"2024-04-26T18:03:24.641851+0000","last_active":"2024-04-26T18:04:31.929493+0000","last_peered":"2024-04-26T18:04:31.929493+0000","last_clean":"2024-04-26T18:04:31.929493+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:04:31.929493+0000","last_undegraded":"2024-04-26T18:04:31.929493+0000","last_fullsized":"2024-04-26T18:04:31.929493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:05.076764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'132","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602929+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T18:08:19.602929+0000","last_peered":"2024-04-26T18:08:19.602929+0000","last_clean":"2024-04-26T18:08:19.602929+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:19.602929+0000","last_undegraded":"2024-04-26T18:08:19.602929+0000","last_fullsized":"2024-04-26T18:08:19.602929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.532024+0000","last_change":"2024-04-26T18:03:24.748734+0000","last_active":"2024-04-26T18:08:26.532024+0000","last_peered":"2024-04-26T18:08:26.532024+0000","last_clean":"2024-04-26T18:08:26.532024+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:26.532024+0000","last_undegraded":"2024-04-26T18:08:26.532024+0000","last_fullsized":"2024-04-26T18:08:26.532024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:50.548538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'89","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.871972+0000","last_change":"2024-04-26T18:03:24.657308+0000","last_active":"2024-04-26T18:05:06.871972+0000","last_peered":"2024-04-26T18:05:06.871972+0000","last_clean":"2024-04-26T18:05:06.871972+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:05:06.871972+0000","last_undegraded":"2024-04-26T18:05:06.871972+0000","last_fullsized":"2024-04-26T18:05:06.871972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:50.688884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.654871+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T18:06:59.654871+0000","last_peered":"2024-04-26T18:06:59.654871+0000","last_clean":"2024-04-26T18:06:59.654871+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:06:59.654871+0000","last_undegraded":"2024-04-26T18:06:59.654871+0000","last_fullsized":"2024-04-26T18:06:59.654871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2738,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.524101+0000","last_change":"2024-04-26T18:03:24.747715+0000","last_active":"2024-04-26T18:08:26.524101+0000","last_peered":"2024-04-26T18:08:26.524101+0000","last_clean":"2024-04-26T18:08:26.524101+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:26.524101+0000","last_undegraded":"2024-04-26T18:08:26.524101+0000","last_fullsized":"2024-04-26T18:08:26.524101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:59.495568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"34'75","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941608+0000","last_change":"2024-04-26T18:03:24.749179+0000","last_active":"2024-04-26T18:06:16.941608+0000","last_peered":"2024-04-26T18:06:16.941608+0000","last_clean":"2024-04-26T18:06:16.941608+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:06:16.941608+0000","last_undegraded":"2024-04-26T18:06:16.941608+0000","last_fullsized":"2024-04-26T18:06:16.941608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:10.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'124","reported_seq":294,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.718532+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T18:06:45.718532+0000","last_peered":"2024-04-26T18:06:45.718532+0000","last_clean":"2024-04-26T18:06:45.718532+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:06:45.718532+0000","last_undegraded":"2024-04-26T18:06:45.718532+0000","last_fullsized":"2024-04-26T18:06:45.718532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2744,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640670+0000","last_change":"2024-04-26T18:03:24.748508+0000","last_active":"2024-04-26T18:08:26.640670+0000","last_peered":"2024-04-26T18:08:26.640670+0000","last_clean":"2024-04-26T18:08:26.640670+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:26.640670+0000","last_undegraded":"2024-04-26T18:08:26.640670+0000","last_fullsized":"2024-04-26T18:08:26.640670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:08:50.836401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"35'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930743+0000","last_change":"2024-04-26T18:03:25.001751+0000","last_active":"2024-04-26T18:04:31.930743+0000","last_peered":"2024-04-26T18:04:31.930743+0000","last_clean":"2024-04-26T18:04:31.930743+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:04:31.930743+0000","last_undegraded":"2024-04-26T18:04:31.930743+0000","last_fullsized":"2024-04-26T18:04:31.930743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'250","reported_seq":301,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:11.941507+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T18:06:11.941507+0000","last_peered":"2024-04-26T18:06:11.941507+0000","last_clean":"2024-04-26T18:06:11.941507+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:06:11.941507+0000","last_undegraded":"2024-04-26T18:06:11.941507+0000","last_fullsized":"2024-04-26T18:06:11.941507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494713+0000","last_change":"2024-04-26T18:03:25.005985+0000","last_active":"2024-04-26T18:08:26.494713+0000","last_peered":"2024-04-26T18:08:26.494713+0000","last_clean":"2024-04-26T18:08:26.494713+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:26.494713+0000","last_undegraded":"2024-04-26T18:08:26.494713+0000","last_fullsized":"2024-04-26T18:08:26.494713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:46.423765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:06.880149+0000","last_change":"2024-04-26T18:03:24.984011+0000","last_active":"2024-04-26T18:05:06.880149+0000","last_peered":"2024-04-26T18:05:06.880149+0000","last_clean":"2024-04-26T18:05:06.880149+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:05:06.880149+0000","last_undegraded":"2024-04-26T18:05:06.880149+0000","last_fullsized":"2024-04-26T18:05:06.880149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:09.171009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'113","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:31.943358+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T18:06:31.943358+0000","last_peered":"2024-04-26T18:06:31.943358+0000","last_clean":"2024-04-26T18:06:31.943358+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:06:31.943358+0000","last_undegraded":"2024-04-26T18:06:31.943358+0000","last_fullsized":"2024-04-26T18:06:31.943358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:06.941024+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T18:06:06.941024+0000","last_peered":"2024-04-26T18:06:06.941024+0000","last_clean":"2024-04-26T18:06:06.941024+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:06:06.941024+0000","last_undegraded":"2024-04-26T18:06:06.941024+0000","last_fullsized":"2024-04-26T18:06:06.941024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.315128+0000","last_change":"2024-04-26T18:03:24.635471+0000","last_active":"2024-04-26T18:08:26.315128+0000","last_peered":"2024-04-26T18:08:26.315128+0000","last_clean":"2024-04-26T18:08:26.315128+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:26.315128+0000","last_undegraded":"2024-04-26T18:08:26.315128+0000","last_fullsized":"2024-04-26T18:08:26.315128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:03.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"34'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933106+0000","last_change":"2024-04-26T18:03:24.944311+0000","last_active":"2024-04-26T18:05:01.933106+0000","last_peered":"2024-04-26T18:05:01.933106+0000","last_clean":"2024-04-26T18:05:01.933106+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:05:01.933106+0000","last_undegraded":"2024-04-26T18:05:01.933106+0000","last_fullsized":"2024-04-26T18:05:01.933106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:11.446948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'339","reported_seq":389,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.895454+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T18:08:18.895454+0000","last_peered":"2024-04-26T18:08:18.895454+0000","last_clean":"2024-04-26T18:08:18.895454+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:18.895454+0000","last_undegraded":"2024-04-26T18:08:18.895454+0000","last_fullsized":"2024-04-26T18:08:18.895454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2790,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.275515+0000","last_change":"2024-04-26T18:03:24.636889+0000","last_active":"2024-04-26T18:08:26.275515+0000","last_peered":"2024-04-26T18:08:26.275515+0000","last_clean":"2024-04-26T18:08:26.275515+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:26.275515+0000","last_undegraded":"2024-04-26T18:08:26.275515+0000","last_fullsized":"2024-04-26T18:08:26.275515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:57.257654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'90","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933112+0000","last_change":"2024-04-26T18:03:24.642373+0000","last_active":"2024-04-26T18:05:01.933112+0000","last_peered":"2024-04-26T18:05:01.933112+0000","last_clean":"2024-04-26T18:05:01.933112+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:05:01.933112+0000","last_undegraded":"2024-04-26T18:05:01.933112+0000","last_fullsized":"2024-04-26T18:05:01.933112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:50.494058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'11","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.319192+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T18:08:23.319192+0000","last_peered":"2024-04-26T18:08:23.319192+0000","last_clean":"2024-04-26T18:08:23.319192+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:23.319192+0000","last_undegraded":"2024-04-26T18:08:23.319192+0000","last_fullsized":"2024-04-26T18:08:23.319192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.339174+0000","last_change":"2024-04-26T18:03:25.011325+0000","last_active":"2024-04-26T18:08:26.339174+0000","last_peered":"2024-04-26T18:08:26.339174+0000","last_clean":"2024-04-26T18:08:26.339174+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:26.339174+0000","last_undegraded":"2024-04-26T18:08:26.339174+0000","last_fullsized":"2024-04-26T18:08:26.339174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:28.586899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933183+0000","last_change":"2024-04-26T18:03:24.946369+0000","last_active":"2024-04-26T18:05:01.933183+0000","last_peered":"2024-04-26T18:05:01.933183+0000","last_clean":"2024-04-26T18:05:01.933183+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:05:01.933183+0000","last_undegraded":"2024-04-26T18:05:01.933183+0000","last_fullsized":"2024-04-26T18:05:01.933183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.852091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'114","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.484515+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T18:08:18.484515+0000","last_peered":"2024-04-26T18:08:18.484515+0000","last_clean":"2024-04-26T18:08:18.484515+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:18.484515+0000","last_undegraded":"2024-04-26T18:08:18.484515+0000","last_fullsized":"2024-04-26T18:08:18.484515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.245217+0000","last_change":"2024-04-26T18:03:24.635236+0000","last_active":"2024-04-26T18:08:26.245217+0000","last_peered":"2024-04-26T18:08:26.245217+0000","last_clean":"2024-04-26T18:08:26.245217+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:26.245217+0000","last_undegraded":"2024-04-26T18:08:26.245217+0000","last_fullsized":"2024-04-26T18:08:26.245217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:48.980355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'61","reported_seq":2130,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933163+0000","last_change":"2024-04-26T18:03:24.944998+0000","last_active":"2024-04-26T18:05:01.933163+0000","last_peered":"2024-04-26T18:05:01.933163+0000","last_clean":"2024-04-26T18:05:01.933163+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:05:01.933163+0000","last_undegraded":"2024-04-26T18:05:01.933163+0000","last_fullsized":"2024-04-26T18:05:01.933163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:30.416363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'61","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.756283+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T18:06:59.756283+0000","last_peered":"2024-04-26T18:06:59.756283+0000","last_clean":"2024-04-26T18:06:59.756283+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:06:59.756283+0000","last_undegraded":"2024-04-26T18:06:59.756283+0000","last_fullsized":"2024-04-26T18:06:59.756283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2819,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.652003+0000","last_change":"2024-04-26T18:03:24.655394+0000","last_active":"2024-04-26T18:08:26.652003+0000","last_peered":"2024-04-26T18:08:26.652003+0000","last_clean":"2024-04-26T18:08:26.652003+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:26.652003+0000","last_undegraded":"2024-04-26T18:08:26.652003+0000","last_fullsized":"2024-04-26T18:08:26.652003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:04.461317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934805+0000","last_change":"2024-04-26T18:03:24.943633+0000","last_active":"2024-04-26T18:05:16.934805+0000","last_peered":"2024-04-26T18:05:16.934805+0000","last_clean":"2024-04-26T18:05:16.934805+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:05:16.934805+0000","last_undegraded":"2024-04-26T18:05:16.934805+0000","last_fullsized":"2024-04-26T18:05:16.934805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:39.290525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949117+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T18:07:31.949117+0000","last_peered":"2024-04-26T18:07:31.949117+0000","last_clean":"2024-04-26T18:07:31.949117+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:07:31.949117+0000","last_undegraded":"2024-04-26T18:07:31.949117+0000","last_fullsized":"2024-04-26T18:07:31.949117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2765,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.500056+0000","last_change":"2024-04-26T18:03:25.006200+0000","last_active":"2024-04-26T18:08:26.500056+0000","last_peered":"2024-04-26T18:08:26.500056+0000","last_clean":"2024-04-26T18:08:26.500056+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:26.500056+0000","last_undegraded":"2024-04-26T18:08:26.500056+0000","last_fullsized":"2024-04-26T18:08:26.500056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:04.984283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903544+0000","last_change":"2024-04-26T18:03:24.636576+0000","last_active":"2024-04-26T18:06:10.903544+0000","last_peered":"2024-04-26T18:06:10.903544+0000","last_clean":"2024-04-26T18:06:10.903544+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:06:10.903544+0000","last_undegraded":"2024-04-26T18:06:10.903544+0000","last_fullsized":"2024-04-26T18:06:10.903544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:01.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949842+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T18:07:31.949842+0000","last_peered":"2024-04-26T18:07:31.949842+0000","last_clean":"2024-04-26T18:07:31.949842+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:07:31.949842+0000","last_undegraded":"2024-04-26T18:07:31.949842+0000","last_fullsized":"2024-04-26T18:07:31.949842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2757,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656750+0000","last_change":"2024-04-26T18:03:24.989125+0000","last_active":"2024-04-26T18:08:26.656750+0000","last_peered":"2024-04-26T18:08:26.656750+0000","last_clean":"2024-04-26T18:08:26.656750+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:26.656750+0000","last_undegraded":"2024-04-26T18:08:26.656750+0000","last_fullsized":"2024-04-26T18:08:26.656750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:28.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"34'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.934828+0000","last_change":"2024-04-26T18:03:24.926906+0000","last_active":"2024-04-26T18:05:16.934828+0000","last_peered":"2024-04-26T18:05:16.934828+0000","last_clean":"2024-04-26T18:05:16.934828+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:05:16.934828+0000","last_undegraded":"2024-04-26T18:05:16.934828+0000","last_fullsized":"2024-04-26T18:05:16.934828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:00.232054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:11.934972+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T18:05:11.934972+0000","last_peered":"2024-04-26T18:05:11.934972+0000","last_clean":"2024-04-26T18:05:11.934972+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:05:11.934972+0000","last_undegraded":"2024-04-26T18:05:11.934972+0000","last_fullsized":"2024-04-26T18:05:11.934972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2700,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.659323+0000","last_change":"2024-04-26T18:03:24.996245+0000","last_active":"2024-04-26T18:08:26.659323+0000","last_peered":"2024-04-26T18:08:26.659323+0000","last_clean":"2024-04-26T18:08:26.659323+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:26.659323+0000","last_undegraded":"2024-04-26T18:08:26.659323+0000","last_fullsized":"2024-04-26T18:08:26.659323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:47.633142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"34'76","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935691+0000","last_change":"2024-04-26T18:03:25.010829+0000","last_active":"2024-04-26T18:05:16.935691+0000","last_peered":"2024-04-26T18:05:16.935691+0000","last_clean":"2024-04-26T18:05:16.935691+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:05:16.935691+0000","last_undegraded":"2024-04-26T18:05:16.935691+0000","last_fullsized":"2024-04-26T18:05:16.935691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:43.796963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949215+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T18:07:31.949215+0000","last_peered":"2024-04-26T18:07:31.949215+0000","last_clean":"2024-04-26T18:07:31.949215+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:07:31.949215+0000","last_undegraded":"2024-04-26T18:07:31.949215+0000","last_fullsized":"2024-04-26T18:07:31.949215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2749,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.079545+0000","last_change":"2024-04-26T18:03:24.641376+0000","last_active":"2024-04-26T18:08:26.079545+0000","last_peered":"2024-04-26T18:08:26.079545+0000","last_clean":"2024-04-26T18:08:26.079545+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:26.079545+0000","last_undegraded":"2024-04-26T18:08:26.079545+0000","last_fullsized":"2024-04-26T18:08:26.079545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.839796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'77","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936646+0000","last_change":"2024-04-26T18:03:24.944051+0000","last_active":"2024-04-26T18:05:31.936646+0000","last_peered":"2024-04-26T18:05:31.936646+0000","last_clean":"2024-04-26T18:05:31.936646+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:05:31.936646+0000","last_undegraded":"2024-04-26T18:05:31.936646+0000","last_fullsized":"2024-04-26T18:05:31.936646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:10.353238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'158","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:22.301921+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T18:08:22.301921+0000","last_peered":"2024-04-26T18:08:22.301921+0000","last_clean":"2024-04-26T18:08:22.301921+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:22.301921+0000","last_undegraded":"2024-04-26T18:08:22.301921+0000","last_fullsized":"2024-04-26T18:08:22.301921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.519720+0000","last_change":"2024-04-26T18:03:24.748793+0000","last_active":"2024-04-26T18:08:26.519720+0000","last_peered":"2024-04-26T18:08:26.519720+0000","last_clean":"2024-04-26T18:08:26.519720+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:26.519720+0000","last_undegraded":"2024-04-26T18:08:26.519720+0000","last_fullsized":"2024-04-26T18:08:26.519720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.947294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903472+0000","last_change":"2024-04-26T18:03:24.657577+0000","last_active":"2024-04-26T18:06:10.903472+0000","last_peered":"2024-04-26T18:06:10.903472+0000","last_clean":"2024-04-26T18:06:10.903472+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:06:10.903472+0000","last_undegraded":"2024-04-26T18:06:10.903472+0000","last_fullsized":"2024-04-26T18:06:10.903472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:58.858205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'332","reported_seq":382,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:01.892123+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T18:08:01.892123+0000","last_peered":"2024-04-26T18:08:01.892123+0000","last_clean":"2024-04-26T18:08:01.892123+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:01.892123+0000","last_undegraded":"2024-04-26T18:08:01.892123+0000","last_fullsized":"2024-04-26T18:08:01.892123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":333,"num_write_kb":8438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.664399+0000","last_change":"2024-04-26T18:03:24.657947+0000","last_active":"2024-04-26T18:08:26.664399+0000","last_peered":"2024-04-26T18:08:26.664399+0000","last_clean":"2024-04-26T18:08:26.664399+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:26.664399+0000","last_undegraded":"2024-04-26T18:08:26.664399+0000","last_fullsized":"2024-04-26T18:08:26.664399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:26.337195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'80","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937139+0000","last_change":"2024-04-26T18:03:25.007674+0000","last_active":"2024-04-26T18:05:31.937139+0000","last_peered":"2024-04-26T18:05:31.937139+0000","last_clean":"2024-04-26T18:05:31.937139+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:05:31.937139+0000","last_undegraded":"2024-04-26T18:05:31.937139+0000","last_fullsized":"2024-04-26T18:05:31.937139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:01.233904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'591","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602792+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T18:08:19.602792+0000","last_peered":"2024-04-26T18:08:19.602792+0000","last_clean":"2024-04-26T18:08:19.602792+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:19.602792+0000","last_undegraded":"2024-04-26T18:08:19.602792+0000","last_fullsized":"2024-04-26T18:08:19.602792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2807,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.680572+0000","last_change":"2024-04-26T18:03:24.997268+0000","last_active":"2024-04-26T18:08:26.680572+0000","last_peered":"2024-04-26T18:08:26.680572+0000","last_clean":"2024-04-26T18:08:26.680572+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:26.680572+0000","last_undegraded":"2024-04-26T18:08:26.680572+0000","last_fullsized":"2024-04-26T18:08:26.680572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:53.318883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"34'95","reported_seq":2149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:46.925955+0000","last_change":"2024-04-26T18:03:24.849449+0000","last_active":"2024-04-26T18:03:46.925955+0000","last_peered":"2024-04-26T18:03:46.925955+0000","last_clean":"2024-04-26T18:03:46.925955+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:03:46.925955+0000","last_undegraded":"2024-04-26T18:03:46.925955+0000","last_fullsized":"2024-04-26T18:03:46.925955+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:00.389514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:51.952068+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T18:07:51.952068+0000","last_peered":"2024-04-26T18:07:51.952068+0000","last_clean":"2024-04-26T18:07:51.952068+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:07:51.952068+0000","last_undegraded":"2024-04-26T18:07:51.952068+0000","last_fullsized":"2024-04-26T18:07:51.952068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2805,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.708112+0000","last_change":"2024-04-26T18:03:24.993538+0000","last_active":"2024-04-26T18:08:26.708112+0000","last_peered":"2024-04-26T18:08:26.708112+0000","last_clean":"2024-04-26T18:08:26.708112+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:26.708112+0000","last_undegraded":"2024-04-26T18:08:26.708112+0000","last_fullsized":"2024-04-26T18:08:26.708112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:29.893910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.493317+0000","last_change":"2024-04-26T18:03:25.003948+0000","last_active":"2024-04-26T18:08:26.493317+0000","last_peered":"2024-04-26T18:08:26.493317+0000","last_clean":"2024-04-26T18:08:26.493317+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:26.493317+0000","last_undegraded":"2024-04-26T18:08:26.493317+0000","last_fullsized":"2024-04-26T18:08:26.493317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:07.242676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.905320+0000","last_change":"2024-04-26T18:03:24.746669+0000","last_active":"2024-04-26T18:06:10.905320+0000","last_peered":"2024-04-26T18:06:10.905320+0000","last_clean":"2024-04-26T18:06:10.905320+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:06:10.905320+0000","last_undegraded":"2024-04-26T18:06:10.905320+0000","last_fullsized":"2024-04-26T18:06:10.905320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:09.392232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'55","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:24.531223+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T18:08:24.531223+0000","last_peered":"2024-04-26T18:08:24.531223+0000","last_clean":"2024-04-26T18:08:24.531223+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:24.531223+0000","last_undegraded":"2024-04-26T18:08:24.531223+0000","last_fullsized":"2024-04-26T18:08:24.531223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2758,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.433695+0000","last_change":"2024-04-26T18:03:24.635733+0000","last_active":"2024-04-26T18:08:26.433695+0000","last_peered":"2024-04-26T18:08:26.433695+0000","last_clean":"2024-04-26T18:08:26.433695+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:26.433695+0000","last_undegraded":"2024-04-26T18:08:26.433695+0000","last_fullsized":"2024-04-26T18:08:26.433695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:06.120357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'102","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.915184+0000","last_change":"2024-04-26T18:03:24.995053+0000","last_active":"2024-04-26T18:06:37.915184+0000","last_peered":"2024-04-26T18:06:37.915184+0000","last_clean":"2024-04-26T18:06:37.915184+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:06:37.915184+0000","last_undegraded":"2024-04-26T18:06:37.915184+0000","last_fullsized":"2024-04-26T18:06:37.915184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:55.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'26","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:52.001657+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T18:07:52.001657+0000","last_peered":"2024-04-26T18:07:52.001657+0000","last_clean":"2024-04-26T18:07:52.001657+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:07:52.001657+0000","last_undegraded":"2024-04-26T18:07:52.001657+0000","last_fullsized":"2024-04-26T18:07:52.001657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1429","reported_seq":1479,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:10.797074+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T18:08:10.797074+0000","last_peered":"2024-04-26T18:08:10.797074+0000","last_clean":"2024-04-26T18:08:10.797074+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:08:10.797074+0000","last_undegraded":"2024-04-26T18:08:10.797074+0000","last_fullsized":"2024-04-26T18:08:10.797074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1429,"log_dups_size":0,"ondisk_log_size":1429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1427,"num_write_kb":17455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938508+0000","last_change":"2024-04-26T18:03:25.011524+0000","last_active":"2024-04-26T18:05:46.938508+0000","last_peered":"2024-04-26T18:05:46.938508+0000","last_clean":"2024-04-26T18:05:46.938508+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:05:46.938508+0000","last_undegraded":"2024-04-26T18:05:46.938508+0000","last_fullsized":"2024-04-26T18:05:46.938508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:37.329300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2733,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.084785+0000","last_change":"2024-04-26T18:03:24.855578+0000","last_active":"2024-04-26T18:08:26.084785+0000","last_peered":"2024-04-26T18:08:26.084785+0000","last_clean":"2024-04-26T18:08:26.084785+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:26.084785+0000","last_undegraded":"2024-04-26T18:08:26.084785+0000","last_fullsized":"2024-04-26T18:08:26.084785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:11.993735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'53","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.720705+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T18:06:45.720705+0000","last_peered":"2024-04-26T18:06:45.720705+0000","last_clean":"2024-04-26T18:06:45.720705+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:06:45.720705+0000","last_undegraded":"2024-04-26T18:06:45.720705+0000","last_fullsized":"2024-04-26T18:06:45.720705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.944631+0000","last_change":"2024-04-26T18:03:24.655256+0000","last_active":"2024-04-26T18:05:46.944631+0000","last_peered":"2024-04-26T18:05:46.944631+0000","last_clean":"2024-04-26T18:05:46.944631+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:05:46.944631+0000","last_undegraded":"2024-04-26T18:05:46.944631+0000","last_fullsized":"2024-04-26T18:05:46.944631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:10.999130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2760,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.582954+0000","last_change":"2024-04-26T18:03:24.995728+0000","last_active":"2024-04-26T18:08:26.582954+0000","last_peered":"2024-04-26T18:08:26.582954+0000","last_clean":"2024-04-26T18:08:26.582954+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:26.582954+0000","last_undegraded":"2024-04-26T18:08:26.582954+0000","last_fullsized":"2024-04-26T18:08:26.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:59.292898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"35'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929463+0000","last_change":"2024-04-26T18:03:24.635879+0000","last_active":"2024-04-26T18:04:31.929463+0000","last_peered":"2024-04-26T18:04:31.929463+0000","last_clean":"2024-04-26T18:04:31.929463+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:04:31.929463+0000","last_undegraded":"2024-04-26T18:04:31.929463+0000","last_fullsized":"2024-04-26T18:04:31.929463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:59.542460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930610+0000","last_change":"2024-04-26T18:03:24.853558+0000","last_active":"2024-04-26T18:04:31.930610+0000","last_peered":"2024-04-26T18:04:31.930610+0000","last_clean":"2024-04-26T18:04:31.930610+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:04:31.930610+0000","last_undegraded":"2024-04-26T18:04:31.930610+0000","last_fullsized":"2024-04-26T18:04:31.930610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:25.997781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'94","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.904089+0000","last_change":"2024-04-26T18:03:24.642154+0000","last_active":"2024-04-26T18:06:10.904089+0000","last_peered":"2024-04-26T18:06:10.904089+0000","last_clean":"2024-04-26T18:06:10.904089+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:06:10.904089+0000","last_undegraded":"2024-04-26T18:06:10.904089+0000","last_fullsized":"2024-04-26T18:06:10.904089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:50.872113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"34'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930784+0000","last_change":"2024-04-26T18:03:25.011221+0000","last_active":"2024-04-26T18:04:31.930784+0000","last_peered":"2024-04-26T18:04:31.930784+0000","last_clean":"2024-04-26T18:04:31.930784+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:04:31.930784+0000","last_undegraded":"2024-04-26T18:04:31.930784+0000","last_fullsized":"2024-04-26T18:04:31.930784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:00.133637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"34'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932533+0000","last_change":"2024-04-26T18:03:24.996541+0000","last_active":"2024-04-26T18:04:46.932533+0000","last_peered":"2024-04-26T18:04:46.932533+0000","last_clean":"2024-04-26T18:04:46.932533+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:04:46.932533+0000","last_undegraded":"2024-04-26T18:04:46.932533+0000","last_fullsized":"2024-04-26T18:04:46.932533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:21.848231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932437+0000","last_change":"2024-04-26T18:03:24.748158+0000","last_active":"2024-04-26T18:04:46.932437+0000","last_peered":"2024-04-26T18:04:46.932437+0000","last_clean":"2024-04-26T18:04:46.932437+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:04:46.932437+0000","last_undegraded":"2024-04-26T18:04:46.932437+0000","last_fullsized":"2024-04-26T18:04:46.932437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.736661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"34'94","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931247+0000","last_change":"2024-04-26T18:03:24.637015+0000","last_active":"2024-04-26T18:04:46.931247+0000","last_peered":"2024-04-26T18:04:46.931247+0000","last_clean":"2024-04-26T18:04:46.931247+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:04:46.931247+0000","last_undegraded":"2024-04-26T18:04:46.931247+0000","last_fullsized":"2024-04-26T18:04:46.931247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:53.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"35'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.932554+0000","last_change":"2024-04-26T18:03:24.988961+0000","last_active":"2024-04-26T18:04:46.932554+0000","last_peered":"2024-04-26T18:04:46.932554+0000","last_clean":"2024-04-26T18:04:46.932554+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:04:46.932554+0000","last_undegraded":"2024-04-26T18:04:46.932554+0000","last_fullsized":"2024-04-26T18:04:46.932554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:44.663355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'85","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:46.931167+0000","last_change":"2024-04-26T18:03:24.637315+0000","last_active":"2024-04-26T18:04:46.931167+0000","last_peered":"2024-04-26T18:04:46.931167+0000","last_clean":"2024-04-26T18:04:46.931167+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:04:46.931167+0000","last_undegraded":"2024-04-26T18:04:46.931167+0000","last_fullsized":"2024-04-26T18:04:46.931167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:28.067247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.934135+0000","last_change":"2024-04-26T18:03:24.989182+0000","last_active":"2024-04-26T18:05:01.934135+0000","last_peered":"2024-04-26T18:05:01.934135+0000","last_clean":"2024-04-26T18:05:01.934135+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:05:01.934135+0000","last_undegraded":"2024-04-26T18:05:01.934135+0000","last_fullsized":"2024-04-26T18:05:01.934135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:40.391182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'85","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:41.937620+0000","last_change":"2024-04-26T18:03:24.852287+0000","last_active":"2024-04-26T18:05:41.937620+0000","last_peered":"2024-04-26T18:05:41.937620+0000","last_clean":"2024-04-26T18:05:41.937620+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:05:41.937620+0000","last_undegraded":"2024-04-26T18:05:41.937620+0000","last_fullsized":"2024-04-26T18:05:41.937620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:31.793462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'79","reported_seq":2148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933958+0000","last_change":"2024-04-26T18:03:25.009931+0000","last_active":"2024-04-26T18:05:01.933958+0000","last_peered":"2024-04-26T18:05:01.933958+0000","last_clean":"2024-04-26T18:05:01.933958+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:05:01.933958+0000","last_undegraded":"2024-04-26T18:05:01.933958+0000","last_fullsized":"2024-04-26T18:05:01.933958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:15.705947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933102+0000","last_change":"2024-04-26T18:03:24.637292+0000","last_active":"2024-04-26T18:05:01.933102+0000","last_peered":"2024-04-26T18:05:01.933102+0000","last_clean":"2024-04-26T18:05:01.933102+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:05:01.933102+0000","last_undegraded":"2024-04-26T18:05:01.933102+0000","last_fullsized":"2024-04-26T18:05:01.933102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:27.406729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:01.933137+0000","last_change":"2024-04-26T18:03:24.944245+0000","last_active":"2024-04-26T18:05:01.933137+0000","last_peered":"2024-04-26T18:05:01.933137+0000","last_clean":"2024-04-26T18:05:01.933137+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:05:01.933137+0000","last_undegraded":"2024-04-26T18:05:01.933137+0000","last_fullsized":"2024-04-26T18:05:01.933137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:06.577309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935431+0000","last_change":"2024-04-26T18:03:24.851534+0000","last_active":"2024-04-26T18:05:16.935431+0000","last_peered":"2024-04-26T18:05:16.935431+0000","last_clean":"2024-04-26T18:05:16.935431+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:05:16.935431+0000","last_undegraded":"2024-04-26T18:05:16.935431+0000","last_fullsized":"2024-04-26T18:05:16.935431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:49.815792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'86","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935510+0000","last_change":"2024-04-26T18:03:24.642437+0000","last_active":"2024-04-26T18:05:16.935510+0000","last_peered":"2024-04-26T18:05:16.935510+0000","last_clean":"2024-04-26T18:05:16.935510+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:05:16.935510+0000","last_undegraded":"2024-04-26T18:05:16.935510+0000","last_fullsized":"2024-04-26T18:05:16.935510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'88","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935454+0000","last_change":"2024-04-26T18:03:24.635610+0000","last_active":"2024-04-26T18:05:16.935454+0000","last_peered":"2024-04-26T18:05:16.935454+0000","last_clean":"2024-04-26T18:05:16.935454+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:05:16.935454+0000","last_undegraded":"2024-04-26T18:05:16.935454+0000","last_fullsized":"2024-04-26T18:05:16.935454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:01.517984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.936205+0000","last_change":"2024-04-26T18:03:24.746082+0000","last_active":"2024-04-26T18:05:16.936205+0000","last_peered":"2024-04-26T18:05:16.936205+0000","last_clean":"2024-04-26T18:05:16.936205+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:05:16.936205+0000","last_undegraded":"2024-04-26T18:05:16.936205+0000","last_fullsized":"2024-04-26T18:05:16.936205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:01.306469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:16.935675+0000","last_change":"2024-04-26T18:03:25.011535+0000","last_active":"2024-04-26T18:05:16.935675+0000","last_peered":"2024-04-26T18:05:16.935675+0000","last_clean":"2024-04-26T18:05:16.935675+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:05:16.935675+0000","last_undegraded":"2024-04-26T18:05:16.935675+0000","last_fullsized":"2024-04-26T18:05:16.935675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:59.943859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"34'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.938476+0000","last_change":"2024-04-26T18:03:24.968688+0000","last_active":"2024-04-26T18:05:31.938476+0000","last_peered":"2024-04-26T18:05:31.938476+0000","last_clean":"2024-04-26T18:05:31.938476+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:05:31.938476+0000","last_undegraded":"2024-04-26T18:05:31.938476+0000","last_fullsized":"2024-04-26T18:05:31.938476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:44.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"34'69","reported_seq":2138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.943075+0000","last_change":"2024-04-26T18:03:24.656824+0000","last_active":"2024-04-26T18:05:31.943075+0000","last_peered":"2024-04-26T18:05:31.943075+0000","last_clean":"2024-04-26T18:05:31.943075+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:05:31.943075+0000","last_undegraded":"2024-04-26T18:05:31.943075+0000","last_fullsized":"2024-04-26T18:05:31.943075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:16.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:10.903023+0000","last_change":"2024-04-26T18:03:24.634849+0000","last_active":"2024-04-26T18:06:10.903023+0000","last_peered":"2024-04-26T18:06:10.903023+0000","last_clean":"2024-04-26T18:06:10.903023+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:06:10.903023+0000","last_undegraded":"2024-04-26T18:06:10.903023+0000","last_fullsized":"2024-04-26T18:06:10.903023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.994234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.937001+0000","last_change":"2024-04-26T18:03:24.636282+0000","last_active":"2024-04-26T18:05:31.937001+0000","last_peered":"2024-04-26T18:05:31.937001+0000","last_clean":"2024-04-26T18:05:31.937001+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:05:31.937001+0000","last_undegraded":"2024-04-26T18:05:31.937001+0000","last_fullsized":"2024-04-26T18:05:31.937001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:07.014169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'73","reported_seq":2142,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:31.936681+0000","last_change":"2024-04-26T18:03:24.946554+0000","last_active":"2024-04-26T18:05:31.936681+0000","last_peered":"2024-04-26T18:05:31.936681+0000","last_clean":"2024-04-26T18:05:31.936681+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:05:31.936681+0000","last_undegraded":"2024-04-26T18:05:31.936681+0000","last_fullsized":"2024-04-26T18:05:31.936681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:44.578641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"34'65","reported_seq":2134,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.939780+0000","last_change":"2024-04-26T18:03:24.995186+0000","last_active":"2024-04-26T18:05:46.939780+0000","last_peered":"2024-04-26T18:05:46.939780+0000","last_clean":"2024-04-26T18:05:46.939780+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:05:46.939780+0000","last_undegraded":"2024-04-26T18:05:46.939780+0000","last_fullsized":"2024-04-26T18:05:46.939780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:02.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"34'99","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938480+0000","last_change":"2024-04-26T18:03:24.942130+0000","last_active":"2024-04-26T18:05:46.938480+0000","last_peered":"2024-04-26T18:05:46.938480+0000","last_clean":"2024-04-26T18:05:46.938480+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:05:46.938480+0000","last_undegraded":"2024-04-26T18:05:46.938480+0000","last_fullsized":"2024-04-26T18:05:46.938480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:58.029188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'86","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:03:56.926877+0000","last_change":"2024-04-26T18:03:24.852029+0000","last_active":"2024-04-26T18:03:56.926877+0000","last_peered":"2024-04-26T18:03:56.926877+0000","last_clean":"2024-04-26T18:03:56.926877+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:03:56.926877+0000","last_undegraded":"2024-04-26T18:03:56.926877+0000","last_fullsized":"2024-04-26T18:03:56.926877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:23.464299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"34'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:46.938521+0000","last_change":"2024-04-26T18:03:24.932964+0000","last_active":"2024-04-26T18:05:46.938521+0000","last_peered":"2024-04-26T18:05:46.938521+0000","last_clean":"2024-04-26T18:05:46.938521+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:05:46.938521+0000","last_undegraded":"2024-04-26T18:05:46.938521+0000","last_fullsized":"2024-04-26T18:05:46.938521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:24.157039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'68","reported_seq":2137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:16.941580+0000","last_change":"2024-04-26T18:03:24.641802+0000","last_active":"2024-04-26T18:06:16.941580+0000","last_peered":"2024-04-26T18:06:16.941580+0000","last_clean":"2024-04-26T18:06:16.941580+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:06:16.941580+0000","last_undegraded":"2024-04-26T18:06:16.941580+0000","last_fullsized":"2024-04-26T18:06:16.941580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:18:40.921369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"34'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.930799+0000","last_change":"2024-04-26T18:03:25.004919+0000","last_active":"2024-04-26T18:04:31.930799+0000","last_peered":"2024-04-26T18:04:31.930799+0000","last_clean":"2024-04-26T18:04:31.930799+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:04:31.930799+0000","last_undegraded":"2024-04-26T18:04:31.930799+0000","last_fullsized":"2024-04-26T18:04:31.930799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:52.306796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'71","reported_seq":2140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:42.865142+0000","last_change":"2024-04-26T18:03:24.745389+0000","last_active":"2024-04-26T18:04:42.865142+0000","last_peered":"2024-04-26T18:04:42.865142+0000","last_clean":"2024-04-26T18:04:42.865142+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:04:42.865142+0000","last_undegraded":"2024-04-26T18:04:42.865142+0000","last_fullsized":"2024-04-26T18:04:42.865142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:12.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"34'78","reported_seq":2147,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:31.929496+0000","last_change":"2024-04-26T18:03:24.945776+0000","last_active":"2024-04-26T18:04:31.929496+0000","last_peered":"2024-04-26T18:04:31.929496+0000","last_clean":"2024-04-26T18:04:31.929496+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:04:31.929496+0000","last_undegraded":"2024-04-26T18:04:31.929496+0000","last_fullsized":"2024-04-26T18:04:31.929496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:13.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5276,"ondisk_log_size":5276,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":227070368,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8619,"num_write_kb":230563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":454197248,"data_stored":454140736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8258,"ondisk_log_size":8258,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371280,"kb_used_data":285960,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94000560,"statfs":{"total":96636764160,"available":96256573440,"internally_reserved":0,"allocated":292823040,"data_stored":292603949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574978,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":441680,"kb_used_data":330056,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93930160,"statfs":{"total":96636764160,"available":96184483840,"internally_reserved":0,"allocated":337977344,"data_stored":337757799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,6,4,0,0,14,0,0,0,28,18],"upper_bound":2048},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574977,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":336168,"kb_used_data":255008,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94035672,"statfs":{"total":96636764160,"available":96292528128,"internally_reserved":0,"allocated":261128192,"data_stored":260910302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574979,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416472,"kb_used_data":304784,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93955368,"statfs":{"total":96636764160,"available":96210296832,"internally_reserved":0,"allocated":312098816,"data_stored":311872770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574977,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":514900,"kb_used_data":389324,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":93856940,"statfs":{"total":96636764160,"available":96109506560,"internally_reserved":0,"allocated":398667776,"data_stored":398447177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":128580039},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574978,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273200,"kb_used_data":197608,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94098640,"statfs":{"total":96636764160,"available":96357007360,"internally_reserved":0,"allocated":202350592,"data_stored":202137513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481284,"kb_used_data":369596,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93890556,"statfs":{"total":96636764160,"available":96143929344,"internally_reserved":0,"allocated":378466304,"data_stored":378246247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574977,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":349180,"kb_used_data":255540,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94022660,"statfs":{"total":96636764160,"available":96279203840,"internally_reserved":0,"allocated":261672960,"data_stored":261445733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58728448,"data_stored":58720416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":46723072,"data_stored":46714498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":62926848,"data_stored":62914686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":62918656,"data_stored":62914650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71311360,"data_stored":71303840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:08:30.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T18:08:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.439+0000 7f00bcc6d640 1 Processor -- start 2024-04-26T18:08:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.439+0000 7f00bcc6d640 1 -- start start 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b8153c50 0x7f00b80cf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00b80caab0 0x7f00b806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00b80cfe90 0x7f00b80702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f00b80c43a0 con 0x7f00b80cfe90 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f00b815a8d0 con 0x7f00b80caab0 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00bcc6d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f00b80cf4c0 con 0x7f00b8153c50 2024-04-26T18:08:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00b80cfe90 0x7f00b80702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f00b80cfe90 0x7f00b80702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41232/0 (socket says 172.21.15.12:41232) 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3004327249 learned_addr learned my addr 172.21.15.12:0/3004327249 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00affff640 1 --2- 172.21.15.12:0/3004327249 >> v2:172.21.15.100:3300/0 conn(0x7f00b80caab0 0x7f00b806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b659c640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b8153c50 0x7f00b80cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3004327249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b8153c50 msgr2=0x7f00b80cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b8153c50 0x7f00b80cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3004327249 >> v2:172.21.15.100:3300/0 conn(0x7f00b80caab0 msgr2=0x7f00b806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3004327249 >> v2:172.21.15.100:3300/0 conn(0x7f00b80caab0 0x7f00b806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.440+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3004327249 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b8159d70 con 0x7f00b80cfe90 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.441+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b80cfe90 0x7f00b80702f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f00b80709f0 tx=0x7f00b002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cafcee561b2f692 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.441+0000 7f00b5d9b640 1 -- 172.21.15.12:0/3004327249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0036070 con 0x7f00b80cfe90 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.441+0000 7f00b5d9b640 1 -- 172.21.15.12:0/3004327249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0031600 con 0x7f00b80cfe90 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.441+0000 7f00b5d9b640 1 -- 172.21.15.12:0/3004327249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b00319d0 con 0x7f00b80cfe90 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3004327249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b80cfe90 msgr2=0x7f00b80702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b80cfe90 0x7f00b80702f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f00b80709f0 tx=0x7f00b002a730 comp rx=0 tx=0).stop 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3004327249 shutdown_connections 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b80cfe90 0x7f00b80702f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3004327249 >> v2:172.21.15.100:3300/0 conn(0x7f00b80caab0 0x7f00b806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3004327249 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b8153c50 0x7f00b80cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3004327249 >> 172.21.15.12:0/3004327249 conn(0x7f00b8071bf0 msgr2=0x7f00b8071fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3004327249 shutdown_connections 2024-04-26T18:08:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.442+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3004327249 wait complete. 2024-04-26T18:08:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.443+0000 7f00bcc6d640 1 Processor -- start 2024-04-26T18:08:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.443+0000 7f00bcc6d640 1 -- start start 2024-04-26T18:08:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b80caab0 0x7f00b814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b80cfe90 0x7f00b81f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f00b815a310 con 0x7f00b8153c50 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f00b815a030 con 0x7f00b80cfe90 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00bcc6d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f00b815a5f0 con 0x7f00b80caab0 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41240/0 (socket says 172.21.15.12:41240) 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3636005180 learned_addr learned my addr 172.21.15.12:0/3636005180 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00affff640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b80cfe90 0x7f00b81f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b659c640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b80caab0 0x7f00b814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b80caab0 msgr2=0x7f00b814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b80caab0 0x7f00b814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b80cfe90 msgr2=0x7f00b81f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b80cfe90 0x7f00b81f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 -- 172.21.15.12:0/3636005180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b814e4f0 con 0x7f00b8153c50 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.444+0000 7f00b6d9d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00b002ad20 tx=0x7f00b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.445+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b003f020 con 0x7f00b8153c50 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.445+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b0037040 con 0x7f00b8153c50 2024-04-26T18:08:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.445+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b0036070 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.445+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b814e7d0 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.445+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b814ed90 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.446+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b8069ae0 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.446+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f00b0042020 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.447+0000 7f00aeffd640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 0x7f009806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.447+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f00b00ac2f0 con 0x7f00b8153c50 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.447+0000 7f00b659c640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 0x7f009806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.447+0000 7f00b659c640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 0x7f009806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006fd0 tx=0x7f00a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:30.452 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.451+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f00b0049030 con 0x7f00b8153c50 2024-04-26T18:08:30.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.639+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00b8076d20 con 0x7f00b8153c50 2024-04-26T18:08:30.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.640+0000 7f00aeffd640 1 -- 172.21.15.12:0/3636005180 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+19032 (secure 0 0 0) 0x7f00b0079c00 con 0x7f00b8153c50 2024-04-26T18:08:30.641 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:30.642 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T18:03:29.528985+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":476,"length":30}]},{"pool":4,"snaps":[{"begin":476,"length":30}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:08:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 msgr2=0x7f009806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 0x7f009806edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00a8006fd0 tx=0x7f00a8008040 comp rx=0 tx=0).stop 2024-04-26T18:08:30.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 msgr2=0x7f00b814f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f00b002ad20 tx=0x7f00b0004a40 comp rx=0 tx=0).stop 2024-04-26T18:08:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 shutdown_connections 2024-04-26T18:08:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00b8153c50 0x7f00b814f940 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b80cfe90 0x7f00b81f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f009806c8f0 0x7f009806edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 --2- 172.21.15.12:0/3636005180 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00b80caab0 0x7f00b814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 >> 172.21.15.12:0/3636005180 conn(0x7f00b8071bf0 msgr2=0x7f00b80cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:30.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 shutdown_connections 2024-04-26T18:08:30.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:30.642+0000 7f00bcc6d640 1 -- 172.21.15.12:0/3636005180 wait complete. 2024-04-26T18:08:31.655 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T18:08:31.656 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:31.774 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 Processor -- start 2024-04-26T18:08:31.775 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 -- start start 2024-04-26T18:08:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff414155f20 0x7ff41415fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 0x7ff4140d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41415bfe0 con 0x7ff4140cc220 2024-04-26T18:08:31.777 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.774+0000 7ff418f9d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7ff41415cbf0 con 0x7ff414155f20 2024-04-26T18:08:31.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff418f9d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff4141601a0 con 0x7ff4140cd890 2024-04-26T18:08:31.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff414155f20 0x7ff41415fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff414155f20 0x7ff41415fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41252/0 (socket says 172.21.15.12:41252) 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 -- 172.21.15.12:0/2845745490 learned_addr learned my addr 172.21.15.12:0/2845745490 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff40bfff640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 0x7ff4140d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 -- 172.21.15.12:0/2845745490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 msgr2=0x7ff4140d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 0x7ff4140d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 -- 172.21.15.12:0/2845745490 >> v1:172.21.15.100:6789/0 conn(0x7ff4140cc220 legacy=0x7ff4140c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff41259c640 1 -- 172.21.15.12:0/2845745490 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41415c2c0 con 0x7ff414155f20 2024-04-26T18:08:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.775+0000 7ff40bfff640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 0x7ff4140d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff41259c640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff41415fc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff404009870 tx=0x7ff40402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192cd7f9397e89f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff411d9b640 1 -- 172.21.15.12:0/2845745490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404037070 con 0x7ff414155f20 2024-04-26T18:08:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff411d9b640 1 -- 172.21.15.12:0/2845745490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff404032440 con 0x7ff414155f20 2024-04-26T18:08:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff411d9b640 1 -- 172.21.15.12:0/2845745490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff404032810 con 0x7ff414155f20 2024-04-26T18:08:31.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff418f9d640 1 -- 172.21.15.12:0/2845745490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 msgr2=0x7ff41415fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff418f9d640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff41415fc60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff404009870 tx=0x7ff40402a2a0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff418f9d640 1 -- 172.21.15.12:0/2845745490 shutdown_connections 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff418f9d640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cd890 0x7ff4140d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.776+0000 7ff418f9d640 1 --2- 172.21.15.12:0/2845745490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff41415fc60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.777+0000 7ff418f9d640 1 -- 172.21.15.12:0/2845745490 >> 172.21.15.12:0/2845745490 conn(0x7ff414068090 msgr2=0x7ff4140684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.777+0000 7ff418f9d640 1 -- 172.21.15.12:0/2845745490 shutdown_connections 2024-04-26T18:08:31.781 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.777+0000 7ff418f9d640 1 -- 172.21.15.12:0/2845745490 wait complete. 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.778+0000 7ff418f9d640 1 Processor -- start 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.778+0000 7ff418f9d640 1 -- start start 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cc220 0x7ff41414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4140cd890 0x7ff41414bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff4141f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7ff41415bcb0 con 0x7ff414155f20 2024-04-26T18:08:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7ff41415c880 con 0x7ff4140cd890 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff418f9d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7ff414156300 con 0x7ff4140cc220 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff4141f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff4141f1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41266/0 (socket says 172.21.15.12:41266) 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 -- 172.21.15.12:0/1694898984 learned_addr learned my addr 172.21.15.12:0/1694898984 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff41259c640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cc220 0x7ff41414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff40bfff640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4140cd890 0x7ff41414bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 -- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cc220 msgr2=0x7ff41414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ff4140cc220 0x7ff41414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 -- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4140cd890 msgr2=0x7ff41414bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4140cd890 0x7ff41414bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41414d900 con 0x7ff414155f20 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.779+0000 7ff412d9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff4141f1af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c700 tx=0x7ff40c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c016020 con 0x7ff414155f20 2024-04-26T18:08:31.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40c00a9f0 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4141f5200 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00ae20 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4141f57c0 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.780+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff414069ae0 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.781+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff40c019020 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40affd640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff3f406c8f0 0x7ff3f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7ff40c08c7d0 con 0x7ff414155f20 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40affd640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7ff3f4076400 0x7ff3f40788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.788 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff40c005820 con 0x7ff3f4076400 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff40c08cb80 con 0x7ff414155f20 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff41259c640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff3f406c8f0 0x7ff3f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40bfff640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7ff3f4076400 0x7ff3f40788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.782+0000 7ff40bfff640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7ff3f4076400 0x7ff3f40788a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.783+0000 7ff41259c640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff3f406c8f0 0x7ff3f406edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff404034000 tx=0x7ff40402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.783+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== osd.0 v2:172.21.15.12:6800/1222565562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff40c005820 con 0x7ff3f4076400 2024-04-26T18:08:31.796 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.796+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 --> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff414076d20 con 0x7ff3f4076400 2024-04-26T18:08:31.797 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff40affd640 1 -- 172.21.15.12:0/1694898984 <== osd.0 v2:172.21.15.12:6800/1222565562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff414076d20 con 0x7ff3f4076400 2024-04-26T18:08:31.797 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:31.797 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:31.797 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7ff3f4076400 msgr2=0x7ff3f40788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:6800/1222565562,v1:172.21.15.12:6801/1222565562] conn(0x7ff3f4076400 0x7ff3f40788a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff3f406c8f0 msgr2=0x7ff3f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7ff3f406c8f0 0x7ff3f406edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff404034000 tx=0x7ff40402e000 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 msgr2=0x7ff4141f1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 --2- 172.21.15.12:0/1694898984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff414155f20 0x7ff4141f1af0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00c700 tx=0x7ff40c00cbc0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff412d9d640 1 -- 172.21.15.12:0/1694898984 reap_dead start 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 shutdown_connections 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 >> 172.21.15.12:0/1694898984 conn(0x7ff414068090 msgr2=0x7ff4140d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:31.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 shutdown_connections 2024-04-26T18:08:31.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.797+0000 7ff418f9d640 1 -- 172.21.15.12:0/1694898984 wait complete. 2024-04-26T18:08:31.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T18:08:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 Processor -- start 2024-04-26T18:08:31.911 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 -- start start 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb738155e50 0x7fb73815c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb7380cd610 0x7fb7380c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7380d1320 0x7fb7380d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fb73815f200 con 0x7fb7380d1320 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fb7380cc6e0 con 0x7fb7380cd610 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.911+0000 7fb73e037640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb7380cc9c0 con 0x7fb738155e50 2024-04-26T18:08:31.913 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7380d1320 0x7fb7380d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7380d1320 0x7fb7380d17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41270/0 (socket says 172.21.15.12:41270) 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 -- 172.21.15.12:0/1519546084 learned_addr learned my addr 172.21.15.12:0/1519546084 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb7377fe640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb738155e50 0x7fb73815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb736ffd640 1 --2- 172.21.15.12:0/1519546084 >> v2:172.21.15.100:3300/0 conn(0x7fb7380cd610 0x7fb7380c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 -- 172.21.15.12:0/1519546084 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb738155e50 msgr2=0x7fb73815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb738155e50 0x7fb73815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 -- 172.21.15.12:0/1519546084 >> v2:172.21.15.100:3300/0 conn(0x7fb7380cd610 msgr2=0x7fb7380c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:31.914 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 --2- 172.21.15.12:0/1519546084 >> v2:172.21.15.100:3300/0 conn(0x7fb7380cd610 0x7fb7380c6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.912+0000 7fb737fff640 1 -- 172.21.15.12:0/1519546084 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73815f4a0 con 0x7fb7380d1320 2024-04-26T18:08:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb737fff640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380d1320 0x7fb7380d17b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb7380cee70 tx=0x7fb73002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaafe4b0991b7fd server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb7367fc640 1 -- 172.21.15.12:0/1519546084 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730036070 con 0x7fb7380d1320 2024-04-26T18:08:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb7367fc640 1 -- 172.21.15.12:0/1519546084 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730031600 con 0x7fb7380d1320 2024-04-26T18:08:31.915 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb7367fc640 1 -- 172.21.15.12:0/1519546084 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7300319d0 con 0x7fb7380d1320 2024-04-26T18:08:31.918 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 -- 172.21.15.12:0/1519546084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380d1320 msgr2=0x7fb7380d17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380d1320 0x7fb7380d17b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb7380cee70 tx=0x7fb73002a730 comp rx=0 tx=0).stop 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 -- 172.21.15.12:0/1519546084 shutdown_connections 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380d1320 0x7fb7380d17b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 --2- 172.21.15.12:0/1519546084 >> v2:172.21.15.100:3300/0 conn(0x7fb7380cd610 0x7fb7380c6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 --2- 172.21.15.12:0/1519546084 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb738155e50 0x7fb73815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 -- 172.21.15.12:0/1519546084 >> 172.21.15.12:0/1519546084 conn(0x7fb7380762e0 msgr2=0x7fb738073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 -- 172.21.15.12:0/1519546084 shutdown_connections 2024-04-26T18:08:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.913+0000 7fb73e037640 1 -- 172.21.15.12:0/1519546084 wait complete. 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.914+0000 7fb73e037640 1 Processor -- start 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 -- start start 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7380d1320 0x7fb738157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb738155e50 0x7fb73814bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fb738156230 con 0x7fb7380cd610 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fb73815fa60 con 0x7fb738155e50 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb73e037640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fb73815ff80 con 0x7fb7380d1320 2024-04-26T18:08:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb7377fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41286/0 (socket says 172.21.15.12:41286) 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.915+0000 7fb7377fe640 1 -- 172.21.15.12:0/3358212113 learned_addr learned my addr 172.21.15.12:0/3358212113 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb736ffd640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7380d1320 0x7fb738157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb737fff640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb738155e50 0x7fb73814bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 -- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7380d1320 msgr2=0x7fb738157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7380d1320 0x7fb738157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 -- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb738155e50 msgr2=0x7fb73814bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb738155e50 0x7fb73814bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 -- 172.21.15.12:0/3358212113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb738158eb0 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb7377fe640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e8a0 tx=0x7fb72800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728017070 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb72800c940 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb738159190 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cd30 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.916+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73815a1e0 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.917+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb738076d20 con 0x7fb7380cd610 2024-04-26T18:08:31.922 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.918+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb72801a070 con 0x7fb7380cd610 2024-04-26T18:08:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.918+0000 7fb71ffff640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 0x7fb72406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.918+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fb72808c0d0 con 0x7fb7380cd610 2024-04-26T18:08:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.918+0000 7fb736ffd640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 0x7fb72406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.919+0000 7fb736ffd640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 0x7fb72406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7380c6a50 tx=0x7fb72c009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:31.922+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb728059a70 con 0x7fb7380cd610 2024-04-26T18:08:32.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.108+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb7380ccce0 con 0x7fb72406c8f0 2024-04-26T18:08:32.109 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.109+0000 7fb71ffff640 1 -- 172.21.15.12:0/3358212113 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb7380ccce0 con 0x7fb72406c8f0 2024-04-26T18:08:32.109 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T18:08:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 msgr2=0x7fb72406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 0x7fb72406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7380c6a50 tx=0x7fb72c009110 comp rx=0 tx=0).stop 2024-04-26T18:08:32.111 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 msgr2=0x7fb73814e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e8a0 tx=0x7fb72800ed60 comp rx=0 tx=0).stop 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 shutdown_connections 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb738155e50 0x7fb73814bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fb72406c8f0 0x7fb72406edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb7380d1320 0x7fb738157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 --2- 172.21.15.12:0/3358212113 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7380cd610 0x7fb73814e4d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 >> 172.21.15.12:0/3358212113 conn(0x7fb7380762e0 msgr2=0x7fb7381597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.112 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 shutdown_connections 2024-04-26T18:08:32.113 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.111+0000 7fb73e037640 1 -- 172.21.15.12:0/3358212113 wait complete. 2024-04-26T18:08:32.122 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T18:08:32.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:32.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.227+0000 7f6fedc47640 1 Processor -- start 2024-04-26T18:08:32.227 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.227+0000 7f6fedc47640 1 -- start start 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fedc47640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fe8155da0 0x7f6fe815c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fedc47640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6fe80c9bd0 0x7f6fe80ca000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fedc47640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe815cb80 con 0x7f6fe80cc950 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fedc47640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe80cebe0 con 0x7f6fe8155da0 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fedc47640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe80ca540 con 0x7f6fe80c9bd0 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6fe8155da0 0x7f6fe815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.229 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe6ffd640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6fe80cc950 0x7f6fe80d12e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46592/0 (socket says 172.21.15.12:46592) 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe6ffd640 1 -- 172.21.15.12:0/2738933873 learned_addr learned my addr 172.21.15.12:0/2738933873 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe7fff640 1 --2- 172.21.15.12:0/2738933873 >> v2:172.21.15.100:3300/0 conn(0x7f6fe80c9bd0 0x7f6fe80ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe77fe640 1 -- 172.21.15.12:0/2738933873 >> v2:172.21.15.100:3300/0 conn(0x7f6fe80c9bd0 msgr2=0x7f6fe80ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe77fe640 1 --2- 172.21.15.12:0/2738933873 >> v2:172.21.15.100:3300/0 conn(0x7f6fe80c9bd0 0x7f6fe80ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe77fe640 1 -- 172.21.15.12:0/2738933873 >> v1:172.21.15.12:6789/0 conn(0x7f6fe80cc950 legacy=0x7f6fe80d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.228+0000 7f6fe77fe640 1 -- 172.21.15.12:0/2738933873 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe80cdcf0 con 0x7f6fe8155da0 2024-04-26T18:08:32.230 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.229+0000 7f6fe77fe640 1 --2- 172.21.15.12:0/2738933873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe8155da0 0x7f6fe815c640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80c8dd0 tx=0x7f6fd802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542be8f44ce7d11d server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.229+0000 7f6fe67fc640 1 -- 172.21.15.12:0/2738933873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8037070 con 0x7f6fe8155da0 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.229+0000 7f6fe67fc640 1 -- 172.21.15.12:0/2738933873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd8032440 con 0x7f6fe8155da0 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.229+0000 7f6fe67fc640 1 -- 172.21.15.12:0/2738933873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8032810 con 0x7f6fe8155da0 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 -- 172.21.15.12:0/2738933873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe8155da0 msgr2=0x7f6fe815c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 --2- 172.21.15.12:0/2738933873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe8155da0 0x7f6fe815c640 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80c8dd0 tx=0x7f6fd802a230 comp rx=0 tx=0).stop 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 -- 172.21.15.12:0/2738933873 shutdown_connections 2024-04-26T18:08:32.232 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 --2- 172.21.15.12:0/2738933873 >> v2:172.21.15.100:3300/0 conn(0x7f6fe80c9bd0 0x7f6fe80ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 --2- 172.21.15.12:0/2738933873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe8155da0 0x7f6fe815c640 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 -- 172.21.15.12:0/2738933873 >> 172.21.15.12:0/2738933873 conn(0x7f6fe8068090 msgr2=0x7f6fe80684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 -- 172.21.15.12:0/2738933873 shutdown_connections 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.230+0000 7f6fedc47640 1 -- 172.21.15.12:0/2738933873 wait complete. 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.231+0000 7f6fedc47640 1 Processor -- start 2024-04-26T18:08:32.233 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.232+0000 7f6fedc47640 1 -- start start 2024-04-26T18:08:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fe80c9bd0 0x7f6fe81f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 0x7f6fe81e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.236 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6fe8155da0 0x7f6fe81f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80ce590 con 0x7f6fe80cc950 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe80ce2b0 con 0x7f6fe80c9bd0 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fedc47640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe80ce870 con 0x7f6fe8155da0 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 0x7f6fe81e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 0x7f6fe81e75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41300/0 (socket says 172.21.15.12:41300) 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 -- 172.21.15.12:0/1050914210 learned_addr learned my addr 172.21.15.12:0/1050914210 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe77fe640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fe80c9bd0 0x7f6fe81f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.237 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe7fff640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6fe8155da0 0x7f6fe81f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 -- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6fe8155da0 msgr2=0x7f6fe81f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6fe8155da0 0x7f6fe81f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 -- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fe80c9bd0 msgr2=0x7f6fe81f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6fe80c9bd0 0x7f6fe81f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe815a480 con 0x7f6fe80cc950 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fe6ffd640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 0x7f6fe81e75f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c430 tx=0x7f6fdc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.233+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc017070 con 0x7f6fe80cc950 2024-04-26T18:08:32.238 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.234+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc005ce0 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.234+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe815b1e0 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.234+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0072f0 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.234+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe815b7a0 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.234+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fe8076d20 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.235+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fdc01a070 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.235+0000 7f6fcffff640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f6fd406c920 0x7f6fd406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f6fdc08b2d0 con 0x7f6fe80cc950 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fe77fe640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f6fd406c920 0x7f6fd406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.239 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fcffff640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7f6fd4076430 0x7f6fd40788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fdc009e50 con 0x7f6fd4076430 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6fdc092050 con 0x7f6fe80cc950 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fe7fff640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7f6fd4076430 0x7f6fd40788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fe7fff640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7f6fd4076430 0x7f6fd40788d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.236+0000 7f6fe77fe640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f6fd406c920 0x7f6fd406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8034000 tx=0x7f6fd802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.240 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.237+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== osd.1 v2:172.21.15.12:6822/214863022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fdc009e50 con 0x7f6fd4076430 2024-04-26T18:08:32.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.250+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 --> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6fe815bd60 con 0x7f6fd4076430 2024-04-26T18:08:32.250 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.250+0000 7f6fcffff640 1 -- 172.21.15.12:0/1050914210 <== osd.1 v2:172.21.15.12:6822/214863022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6fe815bd60 con 0x7f6fd4076430 2024-04-26T18:08:32.251 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:32.251 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:32.251 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7f6fd4076430 msgr2=0x7f6fd40788d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:6822/214863022,v1:172.21.15.12:6823/214863022] conn(0x7f6fd4076430 0x7f6fd40788d0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f6fd406c920 msgr2=0x7f6fd406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f6fd406c920 0x7f6fd406ede0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8034000 tx=0x7f6fd802e000 comp rx=0 tx=0).stop 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 msgr2=0x7f6fe81e75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 --2- 172.21.15.12:0/1050914210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6fe80cc950 0x7f6fe81e75f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c430 tx=0x7f6fdc00c8f0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fe7fff640 1 -- 172.21.15.12:0/1050914210 reap_dead start 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 shutdown_connections 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 >> 172.21.15.12:0/1050914210 conn(0x7f6fe8068090 msgr2=0x7f6fe814c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 shutdown_connections 2024-04-26T18:08:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.251+0000 7f6fedc47640 1 -- 172.21.15.12:0/1050914210 wait complete. 2024-04-26T18:08:32.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T18:08:32.364 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.363+0000 7f23cc81d640 1 Processor -- start 2024-04-26T18:08:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.363+0000 7f23cc81d640 1 -- start start 2024-04-26T18:08:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.363+0000 7f23cc81d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23c8155e50 0x7f23c815c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23cc81d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c815f200 con 0x7f23c80d1320 2024-04-26T18:08:32.365 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23cc81d640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c80cc6e0 con 0x7f23c80cd610 2024-04-26T18:08:32.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23cc81d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f23c80c6980 con 0x7f23c8155e50 2024-04-26T18:08:32.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c659c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f23c8155e50 0x7f23c815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c6d9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f23c80d1320 0x7f23c8166590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46596/0 (socket says 172.21.15.12:46596) 2024-04-26T18:08:32.366 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c6d9d640 1 -- 172.21.15.12:0/3049024140 learned_addr learned my addr 172.21.15.12:0/3049024140 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:32.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c659c640 1 -- 172.21.15.12:0/3049024140 >> v1:172.21.15.100:6789/0 conn(0x7f23c80cd610 legacy=0x7f23c80c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c659c640 1 -- 172.21.15.12:0/3049024140 >> v1:172.21.15.12:6789/0 conn(0x7f23c80d1320 legacy=0x7f23c8166590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c659c640 1 -- 172.21.15.12:0/3049024140 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80cc9c0 con 0x7f23c8155e50 2024-04-26T18:08:32.367 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.364+0000 7f23c559a640 1 -- 172.21.15.12:0/3049024140 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432936535 0 0) 0x7f23c815f200 con 0x7f23c80d1320 2024-04-26T18:08:32.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23c659c640 1 --2- 172.21.15.12:0/3049024140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c815c690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23b80097a0 tx=0x7f23b802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dd24f131d7ad25 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.373 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23c559a640 1 -- 172.21.15.12:0/3049024140 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8037070 con 0x7f23c8155e50 2024-04-26T18:08:32.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23c559a640 1 -- 172.21.15.12:0/3049024140 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8032640 con 0x7f23c8155e50 2024-04-26T18:08:32.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23c559a640 1 -- 172.21.15.12:0/3049024140 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8032a10 con 0x7f23c8155e50 2024-04-26T18:08:32.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23cc81d640 1 -- 172.21.15.12:0/3049024140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 msgr2=0x7f23c815c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.365+0000 7f23cc81d640 1 --2- 172.21.15.12:0/3049024140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c815c690 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23b80097a0 tx=0x7f23b802a2c0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.374 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.366+0000 7f23cc81d640 1 -- 172.21.15.12:0/3049024140 shutdown_connections 2024-04-26T18:08:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.366+0000 7f23cc81d640 1 --2- 172.21.15.12:0/3049024140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c815c690 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.366+0000 7f23cc81d640 1 -- 172.21.15.12:0/3049024140 >> 172.21.15.12:0/3049024140 conn(0x7f23c80762e0 msgr2=0x7f23c8073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.366+0000 7f23cc81d640 1 -- 172.21.15.12:0/3049024140 shutdown_connections 2024-04-26T18:08:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.366+0000 7f23cc81d640 1 -- 172.21.15.12:0/3049024140 wait complete. 2024-04-26T18:08:32.375 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.367+0000 7f23cc81d640 1 Processor -- start 2024-04-26T18:08:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.367+0000 7f23cc81d640 1 -- start start 2024-04-26T18:08:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.367+0000 7f23cc81d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 0x7f23c8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.367+0000 7f23cc81d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23c80d1320 0x7f23c8151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f23c815fa60 con 0x7f23c8155e50 2024-04-26T18:08:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f23c815f780 con 0x7f23c80cd610 2024-04-26T18:08:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f23c8156230 con 0x7f23c80d1320 2024-04-26T18:08:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.377 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41312/0 (socket says 172.21.15.12:41312) 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 -- 172.21.15.12:0/753883295 learned_addr learned my addr 172.21.15.12:0/753883295 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c5d9b640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23c80d1320 0x7f23c8151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c659c640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 0x7f23c8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 -- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23c80d1320 msgr2=0x7f23c8151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23c80d1320 0x7f23c8151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.378 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 -- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 msgr2=0x7f23c8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 0x7f23c8151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 -- 172.21.15.12:0/753883295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c80c8730 con 0x7f23c8155e50 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c659c640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 0x7f23c8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23c6d9d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23c000caf0 tx=0x7f23c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c000aca0 con 0x7f23c8155e50 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c000ae40 con 0x7f23c8155e50 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c81f2990 con 0x7f23c8155e50 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0012640 con 0x7f23c8155e50 2024-04-26T18:08:32.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.368+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c814cef0 con 0x7f23c8155e50 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.369+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c80c8bc0 con 0x7f23c8155e50 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.370+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23c00128a0 con 0x7f23c8155e50 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.370+0000 7f23b6ffd640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.370+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f23c008c680 con 0x7f23c8155e50 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.370+0000 7f23c659c640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.371+0000 7f23c659c640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 0x7f23a806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.375+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f23c005a5e0 con 0x7f23c8155e50 2024-04-26T18:08:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.560+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f23c80ca600 con 0x7f23a806c8f0 2024-04-26T18:08:32.561 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.561+0000 7f23b6ffd640 1 -- 172.21.15.12:0/753883295 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f23c80ca600 con 0x7f23a806c8f0 2024-04-26T18:08:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T18:08:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 msgr2=0x7f23a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 0x7f23a806edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f23b8034000 tx=0x7f23b802e000 comp rx=0 tx=0).stop 2024-04-26T18:08:32.564 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 msgr2=0x7f23c80c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23c000caf0 tx=0x7f23c000a060 comp rx=0 tx=0).stop 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 shutdown_connections 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f23c8155e50 0x7f23c80c8ef0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f23a806c8f0 0x7f23a806edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23c80d1320 0x7f23c8151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 --2- 172.21.15.12:0/753883295 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80cd610 0x7f23c8151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 >> 172.21.15.12:0/753883295 conn(0x7f23c80762e0 msgr2=0x7f23c8154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 shutdown_connections 2024-04-26T18:08:32.565 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.564+0000 7f23cc81d640 1 -- 172.21.15.12:0/753883295 wait complete. 2024-04-26T18:08:32.575 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T18:08:32.575 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.680+0000 7f69c2314640 1 Processor -- start 2024-04-26T18:08:32.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.680+0000 7f69c2314640 1 -- start start 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c2314640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0ce100 0x7f69bc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c2314640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69bc0b5970 0x7f69bc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c2314640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc0738c0 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c2314640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f69bc0b6310 con 0x7f69bc0b5970 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c2314640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc0729d0 con 0x7f69bc0ce100 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c08b1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69bc0b5970 0x7f69bc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69bb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f69bc0cc4f0 0x7f69bc15fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33836/0 (socket says 172.21.15.12:33836) 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69bb7fe640 1 -- 172.21.15.12:0/1069029209 learned_addr learned my addr 172.21.15.12:0/1069029209 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69bbfff640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0ce100 0x7f69bc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c08b1640 1 -- 172.21.15.12:0/1069029209 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0ce100 msgr2=0x7f69bc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c08b1640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0ce100 0x7f69bc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c08b1640 1 -- 172.21.15.12:0/1069029209 >> v1:172.21.15.12:6789/0 conn(0x7f69bc0cc4f0 legacy=0x7f69bc15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.681+0000 7f69c08b1640 1 -- 172.21.15.12:0/1069029209 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc072cb0 con 0x7f69bc0b5970 2024-04-26T18:08:32.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.682+0000 7f69c08b1640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0b5970 0x7f69bc0b5dd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009d90 tx=0x7f69b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0ab6f8d4bcad3f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.682+0000 7f69baffd640 1 -- 172.21.15.12:0/1069029209 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031600 con 0x7f69bc0b5970 2024-04-26T18:08:32.686 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.682+0000 7f69baffd640 1 -- 172.21.15.12:0/1069029209 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b40317a0 con 0x7f69bc0b5970 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.682+0000 7f69baffd640 1 -- 172.21.15.12:0/1069029209 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4031b70 con 0x7f69bc0b5970 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 -- 172.21.15.12:0/1069029209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0b5970 msgr2=0x7f69bc0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0b5970 0x7f69bc0b5dd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f69b4009d90 tx=0x7f69b402a5d0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 -- 172.21.15.12:0/1069029209 shutdown_connections 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0b5970 0x7f69bc0b5dd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 --2- 172.21.15.12:0/1069029209 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0ce100 0x7f69bc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 -- 172.21.15.12:0/1069029209 >> 172.21.15.12:0/1069029209 conn(0x7f69bc068270 msgr2=0x7f69bc068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 -- 172.21.15.12:0/1069029209 shutdown_connections 2024-04-26T18:08:32.687 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.683+0000 7f69c2314640 1 -- 172.21.15.12:0/1069029209 wait complete. 2024-04-26T18:08:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.684+0000 7f69c2314640 1 Processor -- start 2024-04-26T18:08:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.684+0000 7f69c2314640 1 -- start start 2024-04-26T18:08:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0b5970 0x7f69bc158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 0x7f69bc0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc0ce100 0x7f69bc1f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc073550 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f69bc073270 con 0x7f69bc0ce100 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c2314640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f69bc156360 con 0x7f69bc0b5970 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 0x7f69bc0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.689 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 0x7f69bc0c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60340/0 (socket says 172.21.15.12:60340) 2024-04-26T18:08:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 -- 172.21.15.12:0/2285296476 learned_addr learned my addr 172.21.15.12:0/2285296476 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bbfff640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0b5970 0x7f69bc158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.690 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c08b1640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc0ce100 0x7f69bc1f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 -- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0b5970 msgr2=0x7f69bc158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0b5970 0x7f69bc158ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.691 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 -- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc0ce100 msgr2=0x7f69bc1f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc0ce100 0x7f69bc1f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc159590 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bbfff640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f69bc0b5970 0x7f69bc158ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69c08b1640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69bc0ce100 0x7f69bc1f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69bb7fe640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 0x7f69bc0c7b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c4a0 tx=0x7f69ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac017070 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.685+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69ac005ce0 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.686+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac007270 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.686+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc0c8690 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.686+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69bc0c8c50 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.694 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.686+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f69bc1f1780 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.687+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69ac01a070 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.687+0000 7f69b8ff9640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f69a806c920 0x7f69a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f69ac08b280 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69b8ff9640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f69a80763b0 0x7f69a8078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.698 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69ac013e50 con 0x7f69a80763b0 2024-04-26T18:08:32.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f69ac092050 con 0x7f69bc0cc4f0 2024-04-26T18:08:32.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69bbfff640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f69a806c920 0x7f69a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.699 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69c08b1640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f69a80763b0 0x7f69a8078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69bbfff640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f69a806c920 0x7f69a806ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.688+0000 7f69c08b1640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f69a80763b0 0x7f69a8078850 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.700 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.689+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== osd.2 v2:172.21.15.12:6810/1580244255 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69ac013e50 con 0x7f69a80763b0 2024-04-26T18:08:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.702+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 --> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69bc0b7600 con 0x7f69a80763b0 2024-04-26T18:08:32.702 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.702+0000 7f69b8ff9640 1 -- 172.21.15.12:0/2285296476 <== osd.2 v2:172.21.15.12:6810/1580244255 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69bc0b7600 con 0x7f69a80763b0 2024-04-26T18:08:32.703 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:32.703 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:32.703 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f69a80763b0 msgr2=0x7f69a8078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:6810/1580244255,v1:172.21.15.12:6812/1580244255] conn(0x7f69a80763b0 0x7f69a8078850 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.704 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f69a806c920 msgr2=0x7f69a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f69a806c920 0x7f69a806ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f69b0006fd0 tx=0x7f69b0008040 comp rx=0 tx=0).stop 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 msgr2=0x7f69bc0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 --2- 172.21.15.12:0/2285296476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69bc0cc4f0 0x7f69bc0c7b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69ac00c4a0 tx=0x7f69ac00c960 comp rx=0 tx=0).stop 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c08b1640 1 -- 172.21.15.12:0/2285296476 reap_dead start 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 shutdown_connections 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 >> 172.21.15.12:0/2285296476 conn(0x7f69bc068270 msgr2=0x7f69bc14b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 shutdown_connections 2024-04-26T18:08:32.705 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.703+0000 7f69c2314640 1 -- 172.21.15.12:0/2285296476 wait complete. 2024-04-26T18:08:32.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T18:08:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.816+0000 7f79b2919640 1 Processor -- start 2024-04-26T18:08:32.817 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.816+0000 7f79b2919640 1 -- start start 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b2919640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b2919640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79ac0c9d50 0x7f79ac15c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b2919640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac070a70 con 0x7f79ac070630 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b2919640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0ca1e0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b2919640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0ca660 con 0x7f79ac156000 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79abfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79b0eb6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79ac0c9d50 0x7f79ac15c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79abfff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:55462/0 (socket says 172.21.15.12:55462) 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79ab7fe640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f79ac070630 0x7f79ac15bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:44918/0 (socket says 172.21.15.12:44918) 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.817+0000 7f79abfff640 1 -- 172.21.15.12:0/198314970 learned_addr learned my addr 172.21.15.12:0/198314970 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79b0eb6640 1 -- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 msgr2=0x7f79ac0c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79b0eb6640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79b0eb6640 1 -- 172.21.15.12:0/198314970 >> v1:172.21.15.100:6789/0 conn(0x7f79ac070630 legacy=0x7f79ac15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79b0eb6640 1 -- 172.21.15.12:0/198314970 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0ca920 con 0x7f79ac0c9d50 2024-04-26T18:08:32.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79abfff640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.818+0000 7f79b0eb6640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15c270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009d90 tx=0x7f79a402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8dd413f685bc9cb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79aaffd640 1 -- 172.21.15.12:0/198314970 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4031600 con 0x7f79ac0c9d50 2024-04-26T18:08:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79aaffd640 1 -- 172.21.15.12:0/198314970 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a40317a0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79aaffd640 1 -- 172.21.15.12:0/198314970 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a4031b70 con 0x7f79ac0c9d50 2024-04-26T18:08:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 -- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac0c9d50 msgr2=0x7f79ac15c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15c270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f79a4009d90 tx=0x7f79a402a5d0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 -- 172.21.15.12:0/198314970 shutdown_connections 2024-04-26T18:08:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15c270 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 --2- 172.21.15.12:0/198314970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac0c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 -- 172.21.15.12:0/198314970 >> 172.21.15.12:0/198314970 conn(0x7f79ac071d70 msgr2=0x7f79ac072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 -- 172.21.15.12:0/198314970 shutdown_connections 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.819+0000 7f79b2919640 1 -- 172.21.15.12:0/198314970 wait complete. 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.820+0000 7f79b2919640 1 Processor -- start 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 -- start start 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac070630 0x7f79ac1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac06c4d0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac06d190 con 0x7f79ac070630 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79b2919640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac06c650 con 0x7f79ac156000 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79ab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79ab7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60352/0 (socket says 172.21.15.12:60352) 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.821+0000 7f79ab7fe640 1 -- 172.21.15.12:0/4252187628 learned_addr learned my addr 172.21.15.12:0/4252187628 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79abfff640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac070630 0x7f79ac1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79b0eb6640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 -- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 msgr2=0x7f79ac15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 -- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac070630 msgr2=0x7f79ac1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac070630 0x7f79ac1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 -- 172.21.15.12:0/4252187628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0d0250 con 0x7f79ac0c9d50 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79b0eb6640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79ab7fe640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c3f0 tx=0x7f799c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c0074e0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f799c007680 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac0ceee0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799c004a00 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.822+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac0cf9b0 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.823+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac069600 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.824+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f799c01a020 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.824+0000 7f79a8ff9640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 0x7f799806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.824+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f799c08b680 con 0x7f79ac0c9d50 2024-04-26T18:08:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.824+0000 7f79abfff640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 0x7f799806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.825+0000 7f79abfff640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 0x7f799806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009630 tx=0x7f79a0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:32.829 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:32.828+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79ac069600 con 0x7f79ac0c9d50 2024-04-26T18:08:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.014+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f79ac06e3f0 con 0x7f799806c920 2024-04-26T18:08:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.015+0000 7f79a8ff9640 1 -- 172.21.15.12:0/4252187628 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f79ac06e3f0 con 0x7f799806c920 2024-04-26T18:08:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T18:08:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 msgr2=0x7f799806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 0x7f799806ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009630 tx=0x7f79a0009240 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 msgr2=0x7f79ac15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f799c00c3f0 tx=0x7f799c00c8b0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 shutdown_connections 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f799806c920 0x7f799806ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f79ac156000 0x7f79ac15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f79ac0c9d50 0x7f79ac15a830 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 --2- 172.21.15.12:0/4252187628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ac070630 0x7f79ac1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 >> 172.21.15.12:0/4252187628 conn(0x7f79ac071d70 msgr2=0x7f79ac1564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 shutdown_connections 2024-04-26T18:08:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.017+0000 7f79b2919640 1 -- 172.21.15.12:0/4252187628 wait complete. 2024-04-26T18:08:33.028 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T18:08:33.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.133+0000 7f01308f1640 1 Processor -- start 2024-04-26T18:08:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.133+0000 7f01308f1640 1 -- start start 2024-04-26T18:08:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f01308f1640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f012c0ce100 0x7f012c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f01308f1640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 0x7f012c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f01308f1640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f012c0738c0 con 0x7f012c0cc4f0 2024-04-26T18:08:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f01308f1640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f012c0729d0 con 0x7f012c0ce100 2024-04-26T18:08:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f01308f1640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f012c072cb0 con 0x7f012c0b5970 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012a59c640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f012c0ce100 0x7f012c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f0123fff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f012c0cc4f0 0x7f012c15fc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33848/0 (socket says 172.21.15.12:33848) 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f0123fff640 1 -- 172.21.15.12:0/1439031898 learned_addr learned my addr 172.21.15.12:0/1439031898 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012ad9d640 1 --2- 172.21.15.12:0/1439031898 >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 0x7f012c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012a59c640 1 -- 172.21.15.12:0/1439031898 >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 msgr2=0x7f012c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012a59c640 1 --2- 172.21.15.12:0/1439031898 >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 0x7f012c0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012a59c640 1 -- 172.21.15.12:0/1439031898 >> v1:172.21.15.12:6789/0 conn(0x7f012c0cc4f0 legacy=0x7f012c15fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012a59c640 1 -- 172.21.15.12:0/1439031898 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c0b6340 con 0x7f012c0ce100 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f0129d9b640 1 -- 172.21.15.12:0/1439031898 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2784541126 0 0) 0x7f012c0738c0 con 0x7f012c0cc4f0 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.134+0000 7f012ad9d640 1 --2- 172.21.15.12:0/1439031898 >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 0x7f012c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.135+0000 7f012a59c640 1 --2- 172.21.15.12:0/1439031898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c0ce4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f012c08f020 tx=0x7f011c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a796aaae0ae71964 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.135+0000 7f0129d9b640 1 -- 172.21.15.12:0/1439031898 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c037070 con 0x7f012c0ce100 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.135+0000 7f0129d9b640 1 -- 172.21.15.12:0/1439031898 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011c032440 con 0x7f012c0ce100 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.135+0000 7f0129d9b640 1 -- 172.21.15.12:0/1439031898 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011c02ae60 con 0x7f012c0ce100 2024-04-26T18:08:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 -- 172.21.15.12:0/1439031898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 msgr2=0x7f012c0ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 --2- 172.21.15.12:0/1439031898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c0ce4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f012c08f020 tx=0x7f011c02a110 comp rx=0 tx=0).stop 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 -- 172.21.15.12:0/1439031898 shutdown_connections 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 --2- 172.21.15.12:0/1439031898 >> v2:172.21.15.100:3300/0 conn(0x7f012c0b5970 0x7f012c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 --2- 172.21.15.12:0/1439031898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c0ce4e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 -- 172.21.15.12:0/1439031898 >> 172.21.15.12:0/1439031898 conn(0x7f012c068270 msgr2=0x7f012c068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 -- 172.21.15.12:0/1439031898 shutdown_connections 2024-04-26T18:08:33.139 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.136+0000 7f01308f1640 1 -- 172.21.15.12:0/1439031898 wait complete. 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.137+0000 7f01308f1640 1 Processor -- start 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.137+0000 7f01308f1640 1 -- start start 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f012c0b5970 0x7f012c1e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f012c0cc4f0 0x7f012c1e3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c1e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f012c073550 con 0x7f012c0ce100 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f012c073270 con 0x7f012c0b5970 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f01308f1640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f012c156360 con 0x7f012c0cc4f0 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c1e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c1e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60360/0 (socket says 172.21.15.12:60360) 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 -- 172.21.15.12:0/2489349260 learned_addr learned my addr 172.21.15.12:0/2489349260 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012a59c640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f012c0b5970 0x7f012c1e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f0123fff640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f012c0cc4f0 0x7f012c1e3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.144 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 -- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f012c0cc4f0 msgr2=0x7f012c1e3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f012c0cc4f0 0x7f012c1e3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 -- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f012c0b5970 msgr2=0x7f012c1e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f012c0b5970 0x7f012c1e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012c1e23d0 con 0x7f012c0ce100 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f0123fff640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f012c0cc4f0 0x7f012c1e3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f012ad9d640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c1e3580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f012400cef0 tx=0x7f012400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012401a070 con 0x7f012c0ce100 2024-04-26T18:08:33.145 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.138+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012400d860 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.139+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012400dc50 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.139+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f012c1f4c30 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.139+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f012c1f51b0 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.139+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f012c08e2b0 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.140+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f012401d070 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.140+0000 7f0122ffd640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f010c06c8f0 0x7f010c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f012408c850 con 0x7f012c0ce100 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f012a59c640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f010c06c8f0 0x7f010c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0122ffd640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7f010c076400 0x7f010c0788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f010c078f70 con 0x7f010c076400 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f01240912a0 con 0x7f012c0ce100 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0123fff640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7f010c076400 0x7f010c0788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f0123fff640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7f010c076400 0x7f010c0788a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.141+0000 7f012a59c640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f010c06c8f0 0x7f010c06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f011c034000 tx=0x7f011c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.142+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== osd.3 v2:172.21.15.12:6808/3057566562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f010c078f70 con 0x7f010c076400 2024-04-26T18:08:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 --> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f012c076d20 con 0x7f010c076400 2024-04-26T18:08:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f0122ffd640 1 -- 172.21.15.12:0/2489349260 <== osd.3 v2:172.21.15.12:6808/3057566562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f012c076d20 con 0x7f010c076400 2024-04-26T18:08:33.156 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:33.156 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:33.157 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7f010c076400 msgr2=0x7f010c0788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:6808/3057566562,v1:172.21.15.12:6809/3057566562] conn(0x7f010c076400 0x7f010c0788a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f010c06c8f0 msgr2=0x7f010c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f010c06c8f0 0x7f010c06edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f011c034000 tx=0x7f011c02e000 comp rx=0 tx=0).stop 2024-04-26T18:08:33.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.155+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 msgr2=0x7f012c1e3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f01308f1640 1 --2- 172.21.15.12:0/2489349260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f012c0ce100 0x7f012c1e3580 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f012400cef0 tx=0x7f012400a710 comp rx=0 tx=0).stop 2024-04-26T18:08:33.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f012ad9d640 1 -- 172.21.15.12:0/2489349260 reap_dead start 2024-04-26T18:08:33.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 shutdown_connections 2024-04-26T18:08:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 >> 172.21.15.12:0/2489349260 conn(0x7f012c068270 msgr2=0x7f012c0cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 shutdown_connections 2024-04-26T18:08:33.161 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.156+0000 7f01308f1640 1 -- 172.21.15.12:0/2489349260 wait complete. 2024-04-26T18:08:33.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T18:08:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 Processor -- start 2024-04-26T18:08:33.269 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 -- start start 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4864153d80 0x7f48640c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48640c7ab0 0x7f48640c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f486406e260 con 0x7f48641539a0 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f486406e010 con 0x7f48640c7ab0 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.269+0000 7f4869740640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f486406e540 con 0x7f4864153d80 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48640c7ab0 0x7f48640c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48640c7ab0 0x7f48640c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60376/0 (socket says 172.21.15.12:60376) 2024-04-26T18:08:33.272 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 -- 172.21.15.12:0/556333274 learned_addr learned my addr 172.21.15.12:0/556333274 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48627fc640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4864153d80 0x7f48640c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 -- 172.21.15.12:0/556333274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4864153d80 msgr2=0x7f48640c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4864153d80 0x7f48640c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 -- 172.21.15.12:0/556333274 >> v1:172.21.15.100:6789/0 conn(0x7f48641539a0 legacy=0x7f486415a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.270+0000 7f48637fe640 1 -- 172.21.15.12:0/556333274 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486406ee60 con 0x7f48640c7ab0 2024-04-26T18:08:33.273 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f48637fe640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48640c7ab0 0x7f48640c6d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f485c009870 tx=0x7f485c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8fdf36d6d2787b server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4861ffb640 1 -- 172.21.15.12:0/556333274 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c037070 con 0x7f48640c7ab0 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4861ffb640 1 -- 172.21.15.12:0/556333274 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485c02ae50 con 0x7f48640c7ab0 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4861ffb640 1 -- 172.21.15.12:0/556333274 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485c032860 con 0x7f48640c7ab0 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 -- 172.21.15.12:0/556333274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48640c7ab0 msgr2=0x7f48640c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48640c7ab0 0x7f48640c6d00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f485c009870 tx=0x7f485c02a300 comp rx=0 tx=0).stop 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 -- 172.21.15.12:0/556333274 shutdown_connections 2024-04-26T18:08:33.274 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48640c7ab0 0x7f48640c6d00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 --2- 172.21.15.12:0/556333274 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4864153d80 0x7f48640c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 -- 172.21.15.12:0/556333274 >> 172.21.15.12:0/556333274 conn(0x7f48640686c0 msgr2=0x7f486406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 -- 172.21.15.12:0/556333274 shutdown_connections 2024-04-26T18:08:33.275 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.271+0000 7f4869740640 1 -- 172.21.15.12:0/556333274 wait complete. 2024-04-26T18:08:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 Processor -- start 2024-04-26T18:08:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 -- start start 2024-04-26T18:08:33.278 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 0x7f486414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 0x7f48640722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f486406e890 con 0x7f48641539a0 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f486406f420 con 0x7f4864153d80 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.273+0000 7f4869740640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f48640c99f0 con 0x7f48640c7ab0 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60380/0 (socket says 172.21.15.12:60380) 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 -- 172.21.15.12:0/2084264082 learned_addr learned my addr 172.21.15.12:0/2084264082 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:33.279 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f4862ffd640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 0x7f486414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48637fe640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 0x7f48640722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 -- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 msgr2=0x7f486414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 0x7f486414e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 -- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 msgr2=0x7f48640722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 0x7f48640722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 -- 172.21.15.12:0/2084264082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48641f0520 con 0x7f48641539a0 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48637fe640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 0x7f48640722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f4862ffd640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 0x7f486414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:33.280 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f48627fc640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f485800e870 tx=0x7f485800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858017070 con 0x7f48641539a0 2024-04-26T18:08:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485800c940 con 0x7f48641539a0 2024-04-26T18:08:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486414ee90 con 0x7f48641539a0 2024-04-26T18:08:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800cd10 con 0x7f48641539a0 2024-04-26T18:08:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.274+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f486414f450 con 0x7f48641539a0 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.275+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4864076d20 con 0x7f48641539a0 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.276+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f485801a070 con 0x7f48641539a0 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.276+0000 7f484b7fe640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 0x7f485006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.276+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f485808c1a0 con 0x7f48641539a0 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.277+0000 7f4862ffd640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 0x7f485006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.277+0000 7f4862ffd640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 0x7f485006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4854001d70 tx=0x7f4854009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.281+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f485805a180 con 0x7f48641539a0 2024-04-26T18:08:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.469+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f48641f02c0 con 0x7f485006c8f0 2024-04-26T18:08:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.470+0000 7f484b7fe640 1 -- 172.21.15.12:0/2084264082 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4854006b50 con 0x7f485006c8f0 2024-04-26T18:08:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T18:08:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 msgr2=0x7f485006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 0x7f485006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4854001d70 tx=0x7f4854009040 comp rx=0 tx=0).stop 2024-04-26T18:08:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 msgr2=0x7f486414d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f485800e870 tx=0x7f485800ed30 comp rx=0 tx=0).stop 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 shutdown_connections 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4864153d80 0x7f48640722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48641539a0 0x7f486414d930 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f485006c8f0 0x7f485006edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 --2- 172.21.15.12:0/2084264082 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f48640c7ab0 0x7f486414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 >> 172.21.15.12:0/2084264082 conn(0x7f48640686c0 msgr2=0x7f4864151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 shutdown_connections 2024-04-26T18:08:33.474 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.472+0000 7f4869740640 1 -- 172.21.15.12:0/2084264082 wait complete. 2024-04-26T18:08:33.484 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T18:08:33.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.592+0000 7f0e61699640 1 Processor -- start 2024-04-26T18:08:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.592+0000 7f0e61699640 1 -- start start 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e61699640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 0x7f0e5c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e61699640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e5c0cf1a0 0x7f0e5c070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e61699640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5c0cfa60 con 0x7f0e5c0cf580 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e61699640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5c15bc40 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e61699640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c15bf20 con 0x7f0e5c155d40 2024-04-26T18:08:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e5c0cf1a0 0x7f0e5c070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0e5c0cf580 0x7f0e5c0c4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33860/0 (socket says 172.21.15.12:33860) 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5b7fe640 1 -- 172.21.15.12:0/4128457926 learned_addr learned my addr 172.21.15.12:0/4128457926 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5affd640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 0x7f0e5c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5a7fc640 1 -- 172.21.15.12:0/4128457926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 msgr2=0x7f0e5c0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5a7fc640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 0x7f0e5c0c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5a7fc640 1 -- 172.21.15.12:0/4128457926 >> v1:172.21.15.12:6789/0 conn(0x7f0e5c0cf580 legacy=0x7f0e5c0c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5a7fc640 1 -- 172.21.15.12:0/4128457926 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c15c200 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.595 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.593+0000 7f0e5affd640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 0x7f0e5c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.594+0000 7f0e5a7fc640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c070870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7910e0cea2b4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.594+0000 7f0e59ffb640 1 -- 172.21.15.12:0/4128457926 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50037070 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.594+0000 7f0e59ffb640 1 -- 172.21.15.12:0/4128457926 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e50032440 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.594+0000 7f0e59ffb640 1 -- 172.21.15.12:0/4128457926 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50032810 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 -- 172.21.15.12:0/4128457926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 msgr2=0x7f0e5c070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c070870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0e500097a0 tx=0x7f0e5002a210 comp rx=0 tx=0).stop 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 -- 172.21.15.12:0/4128457926 shutdown_connections 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c070870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 --2- 172.21.15.12:0/4128457926 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c155d40 0x7f0e5c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 -- 172.21.15.12:0/4128457926 >> 172.21.15.12:0/4128457926 conn(0x7f0e5c076730 msgr2=0x7f0e5c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 -- 172.21.15.12:0/4128457926 shutdown_connections 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.595+0000 7f0e61699640 1 -- 172.21.15.12:0/4128457926 wait complete. 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.596+0000 7f0e61699640 1 Processor -- start 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.596+0000 7f0e61699640 1 -- start start 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.601 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c0cf580 0x7f0e5c153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e5c155d40 0x7f0e5c153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c156120 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c0ca190 con 0x7f0e5c155d40 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e61699640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c1562a0 con 0x7f0e5c0cf580 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60408/0 (socket says 172.21.15.12:60408) 2024-04-26T18:08:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 -- 172.21.15.12:0/117320021 learned_addr learned my addr 172.21.15.12:0/117320021 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5a7fc640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c0cf580 0x7f0e5c153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5b7fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e5c155d40 0x7f0e5c153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 -- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c0cf580 msgr2=0x7f0e5c153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f0e5c0cf580 0x7f0e5c153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 -- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e5c155d40 msgr2=0x7f0e5c153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e5c155d40 0x7f0e5c153850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5affd640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c14a410 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.597+0000 7f0e5b7fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e5c155d40 0x7f0e5c153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:33.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e5affd640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c149ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c7f0 tx=0x7f0e5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e54015070 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e54007820 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c0c4be0 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e54007bd0 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.598+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c1548c0 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.599+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e5c069ae0 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.604 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.599+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0e54018070 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e437fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0e4806c8f0 0x7f0e4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f0e5408bfe0 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e437fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f0e48076380 0x7f0e48078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e5401de50 con 0x7f0e48076380 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0e54093050 con 0x7f0e5c0cf1a0 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e5a7fc640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0e4806c8f0 0x7f0e4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e5b7fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f0e48076380 0x7f0e48078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.606 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e5a7fc640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0e4806c8f0 0x7f0e4806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e50034000 tx=0x7f0e5002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.600+0000 7f0e5b7fe640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f0e48076380 0x7f0e48078820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.607 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.601+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== osd.4 v2:172.21.15.100:6800/2805574331 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e5401de50 con 0x7f0e48076380 2024-04-26T18:08:33.614 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.614+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 --> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0e5c076d20 con 0x7f0e48076380 2024-04-26T18:08:33.615 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e437fe640 1 -- 172.21.15.12:0/117320021 <== osd.4 v2:172.21.15.100:6800/2805574331 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0e5c076d20 con 0x7f0e48076380 2024-04-26T18:08:33.615 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:33.615 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:33.615 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:33.616 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f0e48076380 msgr2=0x7f0e48078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6800/2805574331,v1:172.21.15.100:6801/2805574331] conn(0x7f0e48076380 0x7f0e48078820 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0e4806c8f0 msgr2=0x7f0e4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f0e4806c8f0 0x7f0e4806edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0e50034000 tx=0x7f0e5002e000 comp rx=0 tx=0).stop 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 msgr2=0x7f0e5c149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 --2- 172.21.15.12:0/117320021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e5c0cf1a0 0x7f0e5c149ed0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400c7f0 tx=0x7f0e5400ccb0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e5b7fe640 1 -- 172.21.15.12:0/117320021 reap_dead start 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 shutdown_connections 2024-04-26T18:08:33.617 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 >> 172.21.15.12:0/117320021 conn(0x7f0e5c076730 msgr2=0x7f0e5c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 shutdown_connections 2024-04-26T18:08:33.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.615+0000 7f0e61699640 1 -- 172.21.15.12:0/117320021 wait complete. 2024-04-26T18:08:33.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T18:08:33.727 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.727+0000 7f7fa081d640 1 Processor -- start 2024-04-26T18:08:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.727+0000 7f7fa081d640 1 -- start start 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7fa081d640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f9c0cd610 0x7f7f9c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7fa081d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0d1320 0x7f7f9c0d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7fa081d640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f9c15f200 con 0x7f7f9c155e50 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7fa081d640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7f9c0c6980 con 0x7f7f9c0cd610 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7fa081d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c0cc6e0 con 0x7f7f9c0d1320 2024-04-26T18:08:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7f99d9b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f9c0cd610 0x7f7f9c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7f9a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f9c155e50 0x7f7f9c0c6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33862/0 (socket says 172.21.15.12:33862) 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.728+0000 7f7f9a59c640 1 -- 172.21.15.12:0/3789708900 learned_addr learned my addr 172.21.15.12:0/3789708900 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f9ad9d640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0d1320 0x7f7f9c0d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f9959a640 1 -- 172.21.15.12:0/3789708900 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628234308 0 0) 0x7f7f9c15f200 con 0x7f7f9c155e50 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f9959a640 1 -- 172.21.15.12:0/3789708900 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f88003520 con 0x7f7f9c155e50 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f99d9b640 1 -- 172.21.15.12:0/3789708900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0d1320 msgr2=0x7f7f9c0d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f99d9b640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0d1320 0x7f7f9c0d17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.730 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f99d9b640 1 -- 172.21.15.12:0/3789708900 >> v1:172.21.15.12:6789/0 conn(0x7f7f9c155e50 legacy=0x7f7f9c0c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.731 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.729+0000 7f7f99d9b640 1 -- 172.21.15.12:0/3789708900 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c0cc9c0 con 0x7f7f9c0cd610 2024-04-26T18:08:33.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7f99d9b640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c0cd610 0x7f7f9c15c690 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009790 tx=0x7f7f8402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96edbdbd4902eb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7f9959a640 1 -- 172.21.15.12:0/3789708900 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84037070 con 0x7f7f9c0cd610 2024-04-26T18:08:33.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7f9959a640 1 -- 172.21.15.12:0/3789708900 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f84032440 con 0x7f7f9c0cd610 2024-04-26T18:08:33.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7f9959a640 1 -- 172.21.15.12:0/3789708900 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f84032810 con 0x7f7f9c0cd610 2024-04-26T18:08:33.732 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 -- 172.21.15.12:0/3789708900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c0cd610 msgr2=0x7f7f9c15c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c0cd610 0x7f7f9c15c690 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009790 tx=0x7f7f8402a210 comp rx=0 tx=0).stop 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 -- 172.21.15.12:0/3789708900 shutdown_connections 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0d1320 0x7f7f9c0d17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 --2- 172.21.15.12:0/3789708900 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c0cd610 0x7f7f9c15c690 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 -- 172.21.15.12:0/3789708900 >> 172.21.15.12:0/3789708900 conn(0x7f7f9c0762e0 msgr2=0x7f7f9c073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 -- 172.21.15.12:0/3789708900 shutdown_connections 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.730+0000 7f7fa081d640 1 -- 172.21.15.12:0/3789708900 wait complete. 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 Processor -- start 2024-04-26T18:08:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 -- start start 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 0x7f7f9c1e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c0d1320 0x7f7f9c1f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c15fa60 con 0x7f7f9c155e50 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7f9c15f780 con 0x7f7f9c0d1320 2024-04-26T18:08:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.732+0000 7f7fa081d640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7f9c156230 con 0x7f7f9c0cd610 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60416/0 (socket says 172.21.15.12:60416) 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 -- 172.21.15.12:0/832071904 learned_addr learned my addr 172.21.15.12:0/832071904 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f99d9b640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c0d1320 0x7f7f9c1f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9a59c640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 0x7f7f9c1e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 -- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 msgr2=0x7f7f9c1e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 0x7f7f9c1e7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 -- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c0d1320 msgr2=0x7f7f9c1f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c0d1320 0x7f7f9c1f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 -- 172.21.15.12:0/832071904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f9c0b3f20 con 0x7f7f9c155e50 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9a59c640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 0x7f7f9c1e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f9ad9d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009dd0 tx=0x7f7f8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c018020 con 0x7f7f9c155e50 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f8c014480 con 0x7f7f9c155e50 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f9c0c95d0 con 0x7f7f9c155e50 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c014870 con 0x7f7f9c155e50 2024-04-26T18:08:33.738 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.733+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f9c1f5040 con 0x7f7f9c155e50 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.734+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f9c076d20 con 0x7f7f9c155e50 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.735+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f8c005d10 con 0x7f7f9c155e50 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.735+0000 7f7f92ffd640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 0x7f7f7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.735+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f7f8c08c9c0 con 0x7f7f9c155e50 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.736+0000 7f7f9a59c640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 0x7f7f7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.736+0000 7f7f9a59c640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 0x7f7f7c06ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007fd0 tx=0x7f7f94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.740+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7f8c08ee20 con 0x7f7f9c155e50 2024-04-26T18:08:33.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.923+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f7f9c15c2f0 con 0x7f7f7c06c920 2024-04-26T18:08:33.924 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.924+0000 7f7f92ffd640 1 -- 172.21.15.12:0/832071904 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f9c15c2f0 con 0x7f7f7c06c920 2024-04-26T18:08:33.925 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T18:08:33.926 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 msgr2=0x7f7f7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 0x7f7f7c06ede0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f94007fd0 tx=0x7f7f94009040 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 msgr2=0x7f7f9c154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009dd0 tx=0x7f7f8c00c490 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 shutdown_connections 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f9c155e50 0x7f7f9c154d00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f9c0d1320 0x7f7f9c1f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7f7c06c920 0x7f7f7c06ede0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 --2- 172.21.15.12:0/832071904 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f9c0cd610 0x7f7f9c1e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:33.927 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 >> 172.21.15.12:0/832071904 conn(0x7f7f9c0762e0 msgr2=0x7f7f9c0cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:33.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 shutdown_connections 2024-04-26T18:08:33.928 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:33.926+0000 7f7fa081d640 1 -- 172.21.15.12:0/832071904 wait complete. 2024-04-26T18:08:33.937 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T18:08:33.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:34.042 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.042+0000 7f78f250a640 1 Processor -- start 2024-04-26T18:08:34.043 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.042+0000 7f78f250a640 1 -- start start 2024-04-26T18:08:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f250a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec155e30 0x7f78ec15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f250a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec0cde10 0x7f78ec0ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.044 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f250a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ec15bdc0 con 0x7f78ec0cc380 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f250a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f78ec0ce8c0 con 0x7f78ec0cde10 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f250a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec15c9d0 con 0x7f78ec155e30 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec0cde10 0x7f78ec0ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f0aa7640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f78ec0cc380 0x7f78ec0c6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33872/0 (socket says 172.21.15.12:33872) 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78f0aa7640 1 -- 172.21.15.12:0/1382631383 learned_addr learned my addr 172.21.15.12:0/1382631383 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78ec0cde10 0x7f78ec0ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60424/0 (socket says 172.21.15.12:60424) 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78ebfff640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec155e30 0x7f78ec15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 -- 172.21.15.12:0/1382631383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec155e30 msgr2=0x7f78ec15fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec155e30 0x7f78ec15fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 -- 172.21.15.12:0/1382631383 >> v1:172.21.15.12:6789/0 conn(0x7f78ec0cc380 legacy=0x7f78ec0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eb7fe640 1 -- 172.21.15.12:0/1382631383 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec15c0a0 con 0x7f78ec0cde10 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.043+0000 7f78eaffd640 1 -- 172.21.15.12:0/1382631383 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393892489 0 0) 0x7f78ec15bdc0 con 0x7f78ec0cc380 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.044+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0cde10 0x7f78ec0ce230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f78e00097a0 tx=0x7f78e002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c44ef71f298d27 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.044+0000 7f78eaffd640 1 -- 172.21.15.12:0/1382631383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0037070 con 0x7f78ec0cde10 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.044+0000 7f78eaffd640 1 -- 172.21.15.12:0/1382631383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0032440 con 0x7f78ec0cde10 2024-04-26T18:08:34.046 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.044+0000 7f78eaffd640 1 -- 172.21.15.12:0/1382631383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0032810 con 0x7f78ec0cde10 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 -- 172.21.15.12:0/1382631383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0cde10 msgr2=0x7f78ec0ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0cde10 0x7f78ec0ce230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f78e00097a0 tx=0x7f78e002a210 comp rx=0 tx=0).stop 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 -- 172.21.15.12:0/1382631383 shutdown_connections 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec0cde10 0x7f78ec0ce230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 --2- 172.21.15.12:0/1382631383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec155e30 0x7f78ec15fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 -- 172.21.15.12:0/1382631383 >> 172.21.15.12:0/1382631383 conn(0x7f78ec068090 msgr2=0x7f78ec068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.049 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 -- 172.21.15.12:0/1382631383 shutdown_connections 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.045+0000 7f78f250a640 1 -- 172.21.15.12:0/1382631383 wait complete. 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.046+0000 7f78f250a640 1 Processor -- start 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.046+0000 7f78f250a640 1 -- start start 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec0cc380 0x7f78ec0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78ec0cde10 0x7f78ec14fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 0x7f78ec1e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec156210 con 0x7f78ec155e30 2024-04-26T18:08:34.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec15c660 con 0x7f78ec0cde10 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f250a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec156390 con 0x7f78ec0cc380 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 0x7f78ec1e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 0x7f78ec1e6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60432/0 (socket says 172.21.15.12:60432) 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 -- 172.21.15.12:0/2399745864 learned_addr learned my addr 172.21.15.12:0/2399745864 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78ec0cde10 0x7f78ec14fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78ebfff640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec0cc380 0x7f78ec0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 -- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec0cc380 msgr2=0x7f78ec0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec0cc380 0x7f78ec0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 -- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78ec0cde10 msgr2=0x7f78ec14fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78ec0cde10 0x7f78ec14fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78f0aa7640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec1e61b0 con 0x7f78ec155e30 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78ec0cde10 0x7f78ec14fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.047+0000 7f78ebfff640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f78ec0cc380 0x7f78ec0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78f0aa7640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 0x7f78ec1e6c70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c730 tx=0x7f78e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e4018070 con 0x7f78ec155e30 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e400ce40 con 0x7f78ec155e30 2024-04-26T18:08:34.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec1e7cd0 con 0x7f78ec155e30 2024-04-26T18:08:34.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e400a860 con 0x7f78ec155e30 2024-04-26T18:08:34.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.048+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec1e6470 con 0x7f78ec155e30 2024-04-26T18:08:34.053 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.049+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78ec1e7a80 con 0x7f78ec155e30 2024-04-26T18:08:34.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.049+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78e400aa00 con 0x7f78ec155e30 2024-04-26T18:08:34.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78e8ff9640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f78d806c8f0 0x7f78d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f78e408b580 con 0x7f78ec155e30 2024-04-26T18:08:34.054 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78e8ff9640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f78d8076390 0x7f78d8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78d8078f00 con 0x7f78d8076390 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f78e4092050 con 0x7f78ec155e30 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78ebfff640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f78d806c8f0 0x7f78d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.050+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f78d8076390 0x7f78d8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.051+0000 7f78ebfff640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f78d806c8f0 0x7f78d806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009b90 tx=0x7f78dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.051+0000 7f78eb7fe640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f78d8076390 0x7f78d8078830 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.055 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.051+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== osd.5 v2:172.21.15.100:6802/4224810891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f78d8078f00 con 0x7f78d8076390 2024-04-26T18:08:34.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 --> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f78ec076d20 con 0x7f78d8076390 2024-04-26T18:08:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78e8ff9640 1 -- 172.21.15.12:0/2399745864 <== osd.5 v2:172.21.15.100:6802/4224810891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f78ec076d20 con 0x7f78d8076390 2024-04-26T18:08:34.065 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:34.066 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:34.066 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f78d8076390 msgr2=0x7f78d8078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78f250a640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6802/4224810891,v1:172.21.15.100:6804/4224810891] conn(0x7f78d8076390 0x7f78d8078830 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f78d806c8f0 msgr2=0x7f78d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.065+0000 7f78f250a640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f78d806c8f0 0x7f78d806edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f78dc009b90 tx=0x7f78dc008040 comp rx=0 tx=0).stop 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 msgr2=0x7f78ec1e6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 --2- 172.21.15.12:0/2399745864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78ec155e30 0x7f78ec1e6c70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f78e400c730 tx=0x7f78e400cbf0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f0aa7640 1 -- 172.21.15.12:0/2399745864 reap_dead start 2024-04-26T18:08:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 shutdown_connections 2024-04-26T18:08:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 >> 172.21.15.12:0/2399745864 conn(0x7f78ec068090 msgr2=0x7f78ec1504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 shutdown_connections 2024-04-26T18:08:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.066+0000 7f78f250a640 1 -- 172.21.15.12:0/2399745864 wait complete. 2024-04-26T18:08:34.076 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T18:08:34.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.178+0000 7f4f51447640 1 Processor -- start 2024-04-26T18:08:34.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.178+0000 7f4f51447640 1 -- start start 2024-04-26T18:08:34.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f51447640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c0cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f51447640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f4c0cc850 0x7f4f4c0c6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f51447640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c0cec40 con 0x7f4f4c15fe30 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f51447640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f4f4c0cd8c0 con 0x7f4f4c0cc850 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f51447640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c0cdba0 con 0x7f4f4c155ea0 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4a7fc640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f4c0cc850 0x7f4f4c0c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4b7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4f4c15fe30 0x7f4f4c0d12e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33886/0 (socket says 172.21.15.12:33886) 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4b7fe640 1 -- 172.21.15.12:0/1531073059 learned_addr learned my addr 172.21.15.12:0/1531073059 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4affd640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c0cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.181 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4a7fc640 1 -- 172.21.15.12:0/1531073059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 msgr2=0x7f4f4c0cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4a7fc640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c0cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4a7fc640 1 -- 172.21.15.12:0/1531073059 >> v1:172.21.15.12:6789/0 conn(0x7f4f4c15fe30 legacy=0x7f4f4c0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f4a7fc640 1 -- 172.21.15.12:0/1531073059 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c0cde80 con 0x7f4f4c0cc850 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.179+0000 7f4f49ffb640 1 -- 172.21.15.12:0/1531073059 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141893882 0 0) 0x7f4f4c0cec40 con 0x7f4f4c15fe30 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.180+0000 7f4f4a7fc640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0c6270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4f340097a0 tx=0x7f4f3402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b53e4a6b443a616 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.182 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.180+0000 7f4f49ffb640 1 -- 172.21.15.12:0/1531073059 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34037070 con 0x7f4f4c0cc850 2024-04-26T18:08:34.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.180+0000 7f4f49ffb640 1 -- 172.21.15.12:0/1531073059 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f34032440 con 0x7f4f4c0cc850 2024-04-26T18:08:34.183 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.180+0000 7f4f49ffb640 1 -- 172.21.15.12:0/1531073059 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f34032810 con 0x7f4f4c0cc850 2024-04-26T18:08:34.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 -- 172.21.15.12:0/1531073059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 msgr2=0x7f4f4c0c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0c6270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4f340097a0 tx=0x7f4f3402a210 comp rx=0 tx=0).stop 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 -- 172.21.15.12:0/1531073059 shutdown_connections 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0c6270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 --2- 172.21.15.12:0/1531073059 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c0cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 -- 172.21.15.12:0/1531073059 >> 172.21.15.12:0/1531073059 conn(0x7f4f4c074510 msgr2=0x7f4f4c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 -- 172.21.15.12:0/1531073059 shutdown_connections 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.181+0000 7f4f51447640 1 -- 172.21.15.12:0/1531073059 wait complete. 2024-04-26T18:08:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.182+0000 7f4f51447640 1 Processor -- start 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.182+0000 7f4f51447640 1 -- start start 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f4c15fe30 0x7f4f4c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0ce720 con 0x7f4f4c0cc850 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4c0ce440 con 0x7f4f4c15fe30 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f51447640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4c156280 con 0x7f4f4c155ea0 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.187 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60462/0 (socket says 172.21.15.12:60462) 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 -- 172.21.15.12:0/3304160166 learned_addr learned my addr 172.21.15.12:0/3304160166 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 -- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 msgr2=0x7f4f4c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 -- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f4c15fe30 msgr2=0x7f4f4c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f4c15fe30 0x7f4f4c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 -- 172.21.15.12:0/3304160166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c0b5580 con 0x7f4f4c0cc850 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f4affd640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e9b0 tx=0x7f4f4400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44017070 con 0x7f4f4c0cc850 2024-04-26T18:08:34.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4400c9a0 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.183+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4400cd90 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.184+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c0b5860 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.184+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f4c1f4a00 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.185+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f4c076d20 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.185+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4f4401a070 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.185+0000 7f4f437fe640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 0x7f4f2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.186+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f4f4408c320 con 0x7f4f4c0cc850 2024-04-26T18:08:34.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.186+0000 7f4f4a7fc640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 0x7f4f2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.186+0000 7f4f4a7fc640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 0x7f4f2c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f34034000 tx=0x7f4f3402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.190+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4f4405a310 con 0x7f4f4c0cc850 2024-04-26T18:08:34.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.375+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f4f4c0ccc50 con 0x7f4f2c06c8f0 2024-04-26T18:08:34.376 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.376+0000 7f4f437fe640 1 -- 172.21.15.12:0/3304160166 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4f4c0ccc50 con 0x7f4f2c06c8f0 2024-04-26T18:08:34.376 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T18:08:34.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 msgr2=0x7f4f2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 0x7f4f2c06edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4f34034000 tx=0x7f4f3402c000 comp rx=0 tx=0).stop 2024-04-26T18:08:34.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 msgr2=0x7f4f4c0b7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e9b0 tx=0x7f4f4400ee70 comp rx=0 tx=0).stop 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 shutdown_connections 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f4c15fe30 0x7f4f4c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f4f2c06c8f0 0x7f4f2c06edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4f4c155ea0 0x7f4f4c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 --2- 172.21.15.12:0/3304160166 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f4c0cc850 0x7f4f4c0b7280 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 >> 172.21.15.12:0/3304160166 conn(0x7f4f4c074510 msgr2=0x7f4f4c0c6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.378+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 shutdown_connections 2024-04-26T18:08:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.379+0000 7f4f51447640 1 -- 172.21.15.12:0/3304160166 wait complete. 2024-04-26T18:08:34.391 INFO:tasks.ceph:Scrubbing osd.6 2024-04-26T18:08:34.391 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:34.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.496+0000 7f2cc0589640 1 Processor -- start 2024-04-26T18:08:34.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.496+0000 7f2cc0589640 1 -- start start 2024-04-26T18:08:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cc0589640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2cb80c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cc0589640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb815c500 con 0x7f2cb806cd20 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cc0589640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb80b1d00 con 0x7f2cb8155d30 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cc0589640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80ca330 con 0x7f2cb80714d0 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbeb26640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2cb806cd20 0x7f2cb8166440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33900/0 (socket says 172.21.15.12:33900) 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbeb26640 1 -- 172.21.15.12:0/25315019 learned_addr learned my addr 172.21.15.12:0/25315019 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2cb80c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729853838 0 0) 0x7f2cb815c500 con 0x7f2cb806cd20 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca4003520 con 0x7f2cb806cd20 2024-04-26T18:08:34.500 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432939208 0 0) 0x7f2ca4003520 con 0x7f2cb806cd20 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 msgr2=0x7f2cb80c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2cb80c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 >> v1:172.21.15.100:6789/0 conn(0x7f2cb8155d30 legacy=0x7f2cb80c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb815ca70 con 0x7f2cb806cd20 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f2cb00019f0 con 0x7f2cb806cd20 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 >> v1:172.21.15.12:6789/0 conn(0x7f2cb806cd20 legacy=0x7f2cb8166440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2ca40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2ca4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.501 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca4004d40 0x7f2ca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.497+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb80ca330 con 0x7f2ca4003f20 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca400ba20 con 0x7f2ca4004d40 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca400bc20 con 0x7f2cb80714d0 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2ca4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbe325640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2ca40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbeb26640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca4004d40 0x7f2ca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 -- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 msgr2=0x7f2ca40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80714d0 0x7f2ca40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 -- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca4004d40 msgr2=0x7f2ca40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca4004d40 0x7f2ca40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbdb24640 1 -- 172.21.15.12:0/25315019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca4003520 con 0x7f2ca4003f20 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.498+0000 7f2cbeb26640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ca4004d40 0x7f2ca40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2ca4004800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009ac0 tx=0x7f2ca4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f4cc1bbb3611d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8036070 con 0x7f2ca4003f20 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8031400 con 0x7f2ca4003f20 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cbd323640 1 -- 172.21.15.12:0/25315019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8009690 con 0x7f2ca4003f20 2024-04-26T18:08:34.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 -- 172.21.15.12:0/25315019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 msgr2=0x7f2ca4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 --2- 172.21.15.12:0/25315019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2ca4004800 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009ac0 tx=0x7f2ca4005830 comp rx=0 tx=0).stop 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cbeb26640 1 -- 172.21.15.12:0/25315019 reap_dead start 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 -- 172.21.15.12:0/25315019 shutdown_connections 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 -- 172.21.15.12:0/25315019 >> 172.21.15.12:0/25315019 conn(0x7f2cb8071e30 msgr2=0x7f2cb8072210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 -- 172.21.15.12:0/25315019 shutdown_connections 2024-04-26T18:08:34.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.499+0000 7f2cc0589640 1 -- 172.21.15.12:0/25315019 wait complete. 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.500+0000 7f2cc0589640 1 Processor -- start 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 -- start start 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2cb80cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80c92d0 0x7f2cb80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb8158ed0 0x7f2cb81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb8071910 con 0x7f2ca4003f20 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb80c5270 con 0x7f2cb8158ed0 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cc0589640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb80700f0 con 0x7f2cb80c92d0 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cbe325640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2cb80cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cbe325640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2cb80cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60486/0 (socket says 172.21.15.12:60486) 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cbe325640 1 -- 172.21.15.12:0/1161924276 learned_addr learned my addr 172.21.15.12:0/1161924276 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cbeb26640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb8158ed0 0x7f2cb81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.501+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80c92d0 0x7f2cb80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.508 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 -- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80c92d0 msgr2=0x7f2cb80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2cb80c92d0 0x7f2cb80c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 -- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb8158ed0 msgr2=0x7f2cb81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb8158ed0 0x7f2cb81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb81f5b90 con 0x7f2ca4003f20 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cbe325640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2cb80cb990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400f820 tx=0x7f2cb400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400fe70 con 0x7f2ca4003f20 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb4018070 con 0x7f2ca4003f20 2024-04-26T18:08:34.509 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb81f58b0 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb400d6d0 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.502+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb80c6f10 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.503+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2cb815a8e0 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cb400d870 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c9c06c920 0x7f2c9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f2cb408bd00 con 0x7f2ca4003f20 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f2c9c076430 0x7f2c9c0788d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2cb4009e50 con 0x7f2c9c076430 2024-04-26T18:08:34.510 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2cb408e400 con 0x7f2ca4003f20 2024-04-26T18:08:34.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c9c06c920 0x7f2c9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.504+0000 7f2cbeb26640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f2c9c076430 0x7f2c9c0788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.505+0000 7f2cbdb24640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c9c06c920 0x7f2c9c06ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8033000 tx=0x7f2ca8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.505+0000 7f2cbeb26640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f2c9c076430 0x7f2c9c0788d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.511 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.506+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== osd.6 v2:172.21.15.100:6824/862079515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2cb4009e50 con 0x7f2c9c076430 2024-04-26T18:08:34.522 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.522+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 --> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2cb8076d20 con 0x7f2c9c076430 2024-04-26T18:08:34.523 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.522+0000 7f2caeffd640 1 -- 172.21.15.12:0/1161924276 <== osd.6 v2:172.21.15.100:6824/862079515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2cb8076d20 con 0x7f2c9c076430 2024-04-26T18:08:34.523 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:34.523 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:34.523 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:34.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f2c9c076430 msgr2=0x7f2c9c0788d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6824/862079515,v1:172.21.15.100:6825/862079515] conn(0x7f2c9c076430 0x7f2c9c0788d0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c9c06c920 msgr2=0x7f2c9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f2c9c06c920 0x7f2c9c06ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8033000 tx=0x7f2ca8008030 comp rx=0 tx=0).stop 2024-04-26T18:08:34.524 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 msgr2=0x7f2cb80cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 --2- 172.21.15.12:0/1161924276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ca4003f20 0x7f2cb80cb990 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2cb400f820 tx=0x7f2cb400fc20 comp rx=0 tx=0).stop 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cbeb26640 1 -- 172.21.15.12:0/1161924276 reap_dead start 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 shutdown_connections 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 >> 172.21.15.12:0/1161924276 conn(0x7f2cb8071e30 msgr2=0x7f2cb8070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 shutdown_connections 2024-04-26T18:08:34.525 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.523+0000 7f2cc0589640 1 -- 172.21.15.12:0/1161924276 wait complete. 2024-04-26T18:08:34.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-26T18:08:34.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 Processor -- start 2024-04-26T18:08:34.636 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 -- start start 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 0x7eff040cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff0415fe30 0x7eff040d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff040cec40 con 0x7eff040cc850 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7eff040cd8c0 con 0x7eff0415fe30 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.636+0000 7eff0912b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7eff040cdba0 con 0x7eff04155ea0 2024-04-26T18:08:34.638 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0359e640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff0415fe30 0x7eff040d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7efefbfff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7eff040cc850 0x7eff040c6270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33914/0 (socket says 172.21.15.12:33914) 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7efefbfff640 1 -- 172.21.15.12:0/1971759269 learned_addr learned my addr 172.21.15.12:0/1971759269 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0359e640 1 -- 172.21.15.12:0/1971759269 >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 msgr2=0x7eff040cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff02d9d640 1 --2- 172.21.15.12:0/1971759269 >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 0x7eff040cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0359e640 1 --2- 172.21.15.12:0/1971759269 >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 0x7eff040cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0359e640 1 -- 172.21.15.12:0/1971759269 >> v1:172.21.15.12:6789/0 conn(0x7eff040cc850 legacy=0x7eff040c6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0259c640 1 -- 172.21.15.12:0/1971759269 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923784701 0 0) 0x7eff040cec40 con 0x7eff040cc850 2024-04-26T18:08:34.639 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff0359e640 1 -- 172.21.15.12:0/1971759269 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff040cde80 con 0x7eff0415fe30 2024-04-26T18:08:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.637+0000 7eff02d9d640 1 --2- 172.21.15.12:0/1971759269 >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 0x7eff040cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0359e640 1 --2- 172.21.15.12:0/1971759269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0415fe30 0x7eff040d12e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7eff04073990 tx=0x7efefc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c63039a3f9acc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0259c640 1 -- 172.21.15.12:0/1971759269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc007740 con 0x7eff0415fe30 2024-04-26T18:08:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0259c640 1 -- 172.21.15.12:0/1971759269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efefc0078e0 con 0x7eff0415fe30 2024-04-26T18:08:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0259c640 1 -- 172.21.15.12:0/1971759269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc007cb0 con 0x7eff0415fe30 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 -- 172.21.15.12:0/1971759269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0415fe30 msgr2=0x7eff040d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 --2- 172.21.15.12:0/1971759269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0415fe30 0x7eff040d12e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7eff04073990 tx=0x7efefc02a710 comp rx=0 tx=0).stop 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 -- 172.21.15.12:0/1971759269 shutdown_connections 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 --2- 172.21.15.12:0/1971759269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff0415fe30 0x7eff040d12e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 --2- 172.21.15.12:0/1971759269 >> v2:172.21.15.100:3300/0 conn(0x7eff04155ea0 0x7eff040cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 -- 172.21.15.12:0/1971759269 >> 172.21.15.12:0/1971759269 conn(0x7eff04074510 msgr2=0x7eff04068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 -- 172.21.15.12:0/1971759269 shutdown_connections 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.638+0000 7eff0912b640 1 -- 172.21.15.12:0/1971759269 wait complete. 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 Processor -- start 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 -- start start 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff040cc850 0x7eff0415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 0x7eff0414e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7eff040ce720 con 0x7eff04155ea0 2024-04-26T18:08:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7eff040ce440 con 0x7eff0415fe30 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.640+0000 7eff0912b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7eff040c6980 con 0x7eff040cc850 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60496/0 (socket says 172.21.15.12:60496) 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 -- 172.21.15.12:0/2502492075 learned_addr learned my addr 172.21.15.12:0/2502492075 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7eff0359e640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 0x7eff0414e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7eff02d9d640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff040cc850 0x7eff0415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 -- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff040cc850 msgr2=0x7eff0415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff040cc850 0x7eff0415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 -- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 msgr2=0x7eff0414e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 0x7eff0414e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 -- 172.21.15.12:0/2502492075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff041f5680 con 0x7eff04155ea0 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7eff0359e640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 0x7eff0414e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefbfff640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c4a0 tx=0x7efeec00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec018070 con 0x7eff04155ea0 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeec0074e0 con 0x7eff04155ea0 2024-04-26T18:08:34.646 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff0414ed80 con 0x7eff04155ea0 2024-04-26T18:08:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeec004a20 con 0x7eff04155ea0 2024-04-26T18:08:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.641+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff0414f340 con 0x7eff04155ea0 2024-04-26T18:08:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.642+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04076d20 con 0x7eff04155ea0 2024-04-26T18:08:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.643+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efeec01b070 con 0x7eff04155ea0 2024-04-26T18:08:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.643+0000 7efefb7fe640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 0x7efee406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.643+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7efeec08b380 con 0x7eff04155ea0 2024-04-26T18:08:34.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.643+0000 7eff02d9d640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 0x7efee406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.644+0000 7eff02d9d640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 0x7efee406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efef400a990 tx=0x7efef4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.648 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.648+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efeec0592e0 con 0x7eff04155ea0 2024-04-26T18:08:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.832+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7eff040ccc50 con 0x7efee406c8f0 2024-04-26T18:08:34.833 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.833+0000 7efefb7fe640 1 -- 172.21.15.12:0/2502492075 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7eff040ccc50 con 0x7efee406c8f0 2024-04-26T18:08:34.833 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 msgr2=0x7efee406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 0x7efee406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efef400a990 tx=0x7efef4008040 comp rx=0 tx=0).stop 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 msgr2=0x7eff040c8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c4a0 tx=0x7efeec00c960 comp rx=0 tx=0).stop 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 shutdown_connections 2024-04-26T18:08:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff0415fe30 0x7eff0414e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff04155ea0 0x7eff040c8690 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7efee406c8f0 0x7efee406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 --2- 172.21.15.12:0/2502492075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7eff040cc850 0x7eff0415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.834+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 >> 172.21.15.12:0/2502492075 conn(0x7eff04074510 msgr2=0x7eff04072930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.835+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 shutdown_connections 2024-04-26T18:08:34.836 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.835+0000 7eff0912b640 1 -- 172.21.15.12:0/2502492075 wait complete. 2024-04-26T18:08:34.846 INFO:tasks.ceph:Scrubbing osd.7 2024-04-26T18:08:34.846 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-26T18:08:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.951+0000 7f416fd19640 1 Processor -- start 2024-04-26T18:08:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.951+0000 7f416fd19640 1 -- start start 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41680ce100 0x7f41680ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680cc4f0 0x7f416815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 0x7f41680b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f41680738c0 con 0x7f41680ce100 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f41680b6310 con 0x7f41680b5970 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416fd19640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4168160160 con 0x7f41680cc4f0 2024-04-26T18:08:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41680ce100 0x7f41680ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41680ce100 0x7f41680ce4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60508/0 (socket says 172.21.15.12:60508) 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 -- 172.21.15.12:0/2926510367 learned_addr learned my addr 172.21.15.12:0/2926510367 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416d2b4640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680cc4f0 0x7f416815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416e2b6640 1 --2- 172.21.15.12:0/2926510367 >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 0x7f41680b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 -- 172.21.15.12:0/2926510367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680cc4f0 msgr2=0x7f416815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680cc4f0 0x7f416815fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 -- 172.21.15.12:0/2926510367 >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 msgr2=0x7f41680b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 --2- 172.21.15.12:0/2926510367 >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 0x7f41680b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416dab5640 1 -- 172.21.15.12:0/2926510367 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680729d0 con 0x7f41680ce100 2024-04-26T18:08:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.952+0000 7f416e2b6640 1 --2- 172.21.15.12:0/2926510367 >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 0x7f41680b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:08:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.953+0000 7f416dab5640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680ce100 0x7f41680ce4e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41680cf200 tx=0x7f416002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339e5905f35485fb server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.953+0000 7f416cab3640 1 -- 172.21.15.12:0/2926510367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160037070 con 0x7f41680ce100 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.953+0000 7f416cab3640 1 -- 172.21.15.12:0/2926510367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4160032440 con 0x7f41680ce100 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.953+0000 7f416cab3640 1 -- 172.21.15.12:0/2926510367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160032810 con 0x7f41680ce100 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 -- 172.21.15.12:0/2926510367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680ce100 msgr2=0x7f41680ce4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680ce100 0x7f41680ce4e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f41680cf200 tx=0x7f416002a140 comp rx=0 tx=0).stop 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 -- 172.21.15.12:0/2926510367 shutdown_connections 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 --2- 172.21.15.12:0/2926510367 >> v2:172.21.15.100:3300/0 conn(0x7f41680b5970 0x7f41680b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680cc4f0 0x7f416815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 --2- 172.21.15.12:0/2926510367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680ce100 0x7f41680ce4e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 -- 172.21.15.12:0/2926510367 >> 172.21.15.12:0/2926510367 conn(0x7f4168068270 msgr2=0x7f4168068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 -- 172.21.15.12:0/2926510367 shutdown_connections 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.954+0000 7f416fd19640 1 -- 172.21.15.12:0/2926510367 wait complete. 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.955+0000 7f416fd19640 1 Processor -- start 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.955+0000 7f416fd19640 1 -- start start 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41680b5970 0x7f41680d17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 0x7f41680cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680ce100 0x7f41680d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f4168073270 con 0x7f41680cc4f0 2024-04-26T18:08:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f4168072f90 con 0x7f41680b5970 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416fd19640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f4168073550 con 0x7f41680ce100 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 0x7f41680cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 0x7f41680cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60522/0 (socket says 172.21.15.12:60522) 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 -- 172.21.15.12:0/398713469 learned_addr learned my addr 172.21.15.12:0/398713469 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 -- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680ce100 msgr2=0x7f41680d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f41680ce100 0x7f41680d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 -- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41680b5970 msgr2=0x7f41680d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41680b5970 0x7f41680d17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41680d2140 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f416d2b4640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 0x7f41680cff60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f415c00d830 tx=0x7f415c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.956+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c00b6c0 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.957+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c019070 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.957+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416815f840 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.957+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c00ba80 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.957+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41680cf480 con 0x7f41680cc4f0 2024-04-26T18:08:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.957+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f416808e2b0 con 0x7f41680cc4f0 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.958+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f415c01e460 con 0x7f41680cc4f0 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.958+0000 7f41667fc640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f415406c8f0 0x7f415406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.958+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f415c08c700 con 0x7f41680cc4f0 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f41667fc640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f4154076400 0x7f41540788a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4154078f70 con 0x7f4154076400 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f416dab5640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f415406c8f0 0x7f415406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f415c093050 con 0x7f41680cc4f0 2024-04-26T18:08:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f416e2b6640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f4154076400 0x7f41540788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f416dab5640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f415406c8f0 0x7f415406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f416002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.959+0000 7f416e2b6640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f4154076400 0x7f41540788a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:34.964 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.960+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== osd.7 v2:172.21.15.100:6816/2213109725 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4154078f70 con 0x7f4154076400 2024-04-26T18:08:34.973 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.973+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 --> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f41680cf270 con 0x7f4154076400 2024-04-26T18:08:34.974 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.973+0000 7f41667fc640 1 -- 172.21.15.12:0/398713469 <== osd.7 v2:172.21.15.100:6816/2213109725 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f41680cf270 con 0x7f4154076400 2024-04-26T18:08:34.974 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2024-04-26T18:08:34.974 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T18:08:34.974 INFO:teuthology.orchestra.run.smithi012.stdout:} 2024-04-26T18:08:34.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f4154076400 msgr2=0x7f41540788a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6816/2213109725,v1:172.21.15.100:6817/2213109725] conn(0x7f4154076400 0x7f41540788a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.975 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f415406c8f0 msgr2=0x7f415406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f415406c8f0 0x7f415406edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4160034000 tx=0x7f416002c000 comp rx=0 tx=0).stop 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 msgr2=0x7f41680cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 --2- 172.21.15.12:0/398713469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41680cc4f0 0x7f41680cff60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f415c00d830 tx=0x7f415c00dcf0 comp rx=0 tx=0).stop 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416e2b6640 1 -- 172.21.15.12:0/398713469 reap_dead start 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 shutdown_connections 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 >> 172.21.15.12:0/398713469 conn(0x7f4168068270 msgr2=0x7f41680c7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 shutdown_connections 2024-04-26T18:08:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:34.974+0000 7f416fd19640 1 -- 172.21.15.12:0/398713469 wait complete. 2024-04-26T18:08:34.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-26T18:08:35.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.086+0000 7f7dc0a46640 1 Processor -- start 2024-04-26T18:08:35.087 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.086+0000 7f7dc0a46640 1 -- start start 2024-04-26T18:08:35.095 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dc0a46640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7dbc0c4370 0x7f7dbc0cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dc0a46640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc06fa50 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dc0a46640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc06fd30 con 0x7f7dbc153c90 2024-04-26T18:08:35.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dc0a46640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc0cb7b0 con 0x7f7dbc0c4370 2024-04-26T18:08:35.096 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dbad9d640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7dbc0cb3a0 0x7f7dbc0c4d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33924/0 (socket says 172.21.15.12:33924) 2024-04-26T18:08:35.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7dbad9d640 1 -- 172.21.15.12:0/2596770522 learned_addr learned my addr 172.21.15.12:0/2596770522 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:35.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.087+0000 7f7db9d9b640 1 --2- 172.21.15.12:0/2596770522 >> v2:172.21.15.100:3300/0 conn(0x7f7dbc0c4370 0x7f7dbc0cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db959a640 1 -- 172.21.15.12:0/2596770522 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 403546570 0 0) 0x7f7dbc06fa50 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.097 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db959a640 1 -- 172.21.15.12:0/2596770522 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da8003520 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db9d9b640 1 -- 172.21.15.12:0/2596770522 >> v1:172.21.15.100:6789/0 conn(0x7f7dbc153c90 legacy=0x7f7dbc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db9d9b640 1 -- 172.21.15.12:0/2596770522 >> v1:172.21.15.12:6789/0 conn(0x7f7dbc0cb3a0 legacy=0x7f7dbc0c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db9d9b640 1 -- 172.21.15.12:0/2596770522 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc070010 con 0x7f7dbc0c4370 2024-04-26T18:08:35.098 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.088+0000 7f7db9d9b640 1 --2- 172.21.15.12:0/2596770522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc0c4370 0x7f7dbc0cae60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097a0 tx=0x7f7da402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=946621cda8d451aa server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7db959a640 1 -- 172.21.15.12:0/2596770522 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4037070 con 0x7f7dbc0c4370 2024-04-26T18:08:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7db959a640 1 -- 172.21.15.12:0/2596770522 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4032440 con 0x7f7dbc0c4370 2024-04-26T18:08:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7db959a640 1 -- 172.21.15.12:0/2596770522 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4032810 con 0x7f7dbc0c4370 2024-04-26T18:08:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 -- 172.21.15.12:0/2596770522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc0c4370 msgr2=0x7f7dbc0cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.099 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/2596770522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc0c4370 0x7f7dbc0cae60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7da40097a0 tx=0x7f7da402a1a0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 -- 172.21.15.12:0/2596770522 shutdown_connections 2024-04-26T18:08:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/2596770522 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc0c4370 0x7f7dbc0cae60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 -- 172.21.15.12:0/2596770522 >> 172.21.15.12:0/2596770522 conn(0x7f7dbc071d70 msgr2=0x7f7dbc072180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:35.100 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 -- 172.21.15.12:0/2596770522 shutdown_connections 2024-04-26T18:08:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.089+0000 7f7dc0a46640 1 -- 172.21.15.12:0/2596770522 wait complete. 2024-04-26T18:08:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 Processor -- start 2024-04-26T18:08:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 -- start start 2024-04-26T18:08:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dbc0c4370 0x7f7dbc1f0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.101 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc153c90 0x7f7dbc14d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0ccca0 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc0705d0 con 0x7f7dbc153c90 2024-04-26T18:08:35.102 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7dc0a46640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc0c47c0 con 0x7f7dbc0c4370 2024-04-26T18:08:35.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7db9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7db9d9b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60528/0 (socket says 172.21.15.12:60528) 2024-04-26T18:08:35.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.091+0000 7f7db9d9b640 1 -- 172.21.15.12:0/1354452459 learned_addr learned my addr 172.21.15.12:0/1354452459 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:35.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7dbad9d640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc153c90 0x7f7dbc14d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.103 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7dba59c640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dbc0c4370 0x7f7dbc1f0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 -- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dbc0c4370 msgr2=0x7f7dbc1f0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dbc0c4370 0x7f7dbc1f0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 -- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc153c90 msgr2=0x7f7dbc14d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc153c90 0x7f7dbc14d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.104 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 -- 172.21.15.12:0/1354452459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0c8e20 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db9d9b640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7da4035040 tx=0x7f7da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4037040 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4030500 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.105 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da40308d0 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc0d01c0 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.092+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc0c90c0 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.093+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc0c9290 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.094+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7da4044020 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.106 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.094+0000 7f7db2ffd640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 0x7f7d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.094+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f7da40ac2f0 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.094+0000 7f7dba59c640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 0x7f7d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.107 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.095+0000 7f7dba59c640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 0x7f7d9c06edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007fd0 tx=0x7f7db4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.108 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.099+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7da407a250 con 0x7f7dbc0cb3a0 2024-04-26T18:08:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.290+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f7dbc1572b0 con 0x7f7d9c06c8f0 2024-04-26T18:08:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.291+0000 7f7db2ffd640 1 -- 172.21.15.12:0/1354452459 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7dbc1572b0 con 0x7f7d9c06c8f0 2024-04-26T18:08:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 msgr2=0x7f7d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 0x7f7d9c06edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7db4007fd0 tx=0x7f7db4009040 comp rx=0 tx=0).stop 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 msgr2=0x7f7dbc0cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7da4035040 tx=0x7f7da40046c0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 shutdown_connections 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dbc153c90 0x7f7dbc14d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7dbc0cb3a0 0x7f7dbc0cde90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7d9c06c8f0 0x7f7d9c06edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 --2- 172.21.15.12:0/1354452459 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7dbc0c4370 0x7f7dbc1f0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 >> 172.21.15.12:0/1354452459 conn(0x7f7dbc071d70 msgr2=0x7f7dbc157830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 shutdown_connections 2024-04-26T18:08:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.293+0000 7f7dc0a46640 1 -- 172.21.15.12:0/1354452459 wait complete. 2024-04-26T18:08:35.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:08:35.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.405+0000 7f40660f8640 1 Processor -- start 2024-04-26T18:08:35.406 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f40660f8640 1 -- start start 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f40660f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 0x7f406015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f40660f8640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406015f2a0 con 0x7f40600cd840 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f40660f8640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406015f580 con 0x7f4060155da0 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f40660f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f406015cbc0 con 0x7f4060156180 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f405ffff640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f40600cd840 0x7f40600c62a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33938/0 (socket says 172.21.15.12:33938) 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.406+0000 7f405ffff640 1 -- 172.21.15.12:0/1971872731 learned_addr learned my addr 172.21.15.12:0/1971872731 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:08:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405effd640 1 --2- 172.21.15.12:0/1971872731 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 0x7f406015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226891110 0 0) 0x7f406015f2a0 con 0x7f40600cd840 2024-04-26T18:08:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048003520 con 0x7f40600cd840 2024-04-26T18:08:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1190129120 0 0) 0x7f406015f580 con 0x7f4060155da0 2024-04-26T18:08:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f406015f2a0 con 0x7f4060155da0 2024-04-26T18:08:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3750846005 0 0) 0x7f4048003520 con 0x7f40600cd840 2024-04-26T18:08:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405effd640 1 -- 172.21.15.12:0/1971872731 >> v1:172.21.15.100:6789/0 conn(0x7f4060155da0 legacy=0x7f40600d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405effd640 1 -- 172.21.15.12:0/1971872731 >> v1:172.21.15.12:6789/0 conn(0x7f40600cd840 legacy=0x7f40600c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.407+0000 7f405effd640 1 -- 172.21.15.12:0/1971872731 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406015f860 con 0x7f4060156180 2024-04-26T18:08:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f405effd640 1 --2- 172.21.15.12:0/1971872731 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 0x7f406015c680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40540097d0 tx=0x7f405402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66f66b775c3aa741 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054037070 con 0x7f4060156180 2024-04-26T18:08:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405402ab90 con 0x7f4060156180 2024-04-26T18:08:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f405e7fc640 1 -- 172.21.15.12:0/1971872731 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580019f0 con 0x7f4060156180 2024-04-26T18:08:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 -- 172.21.15.12:0/1971872731 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 msgr2=0x7f406015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 --2- 172.21.15.12:0/1971872731 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 0x7f406015c680 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40540097d0 tx=0x7f405402a100 comp rx=0 tx=0).stop 2024-04-26T18:08:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 -- 172.21.15.12:0/1971872731 shutdown_connections 2024-04-26T18:08:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 --2- 172.21.15.12:0/1971872731 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060156180 0x7f406015c680 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 -- 172.21.15.12:0/1971872731 >> 172.21.15.12:0/1971872731 conn(0x7f4060068090 msgr2=0x7f40600684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.408+0000 7f40660f8640 1 -- 172.21.15.12:0/1971872731 shutdown_connections 2024-04-26T18:08:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.409+0000 7f40660f8640 1 -- 172.21.15.12:0/1971872731 wait complete. 2024-04-26T18:08:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 Processor -- start 2024-04-26T18:08:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 -- start start 2024-04-26T18:08:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060155da0 0x7f4060153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 0x7f40601f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f40600d19d0 con 0x7f40600cd840 2024-04-26T18:08:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f40600cc730 con 0x7f40601e4fd0 2024-04-26T18:08:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.410+0000 7f40660f8640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f40600d1b50 con 0x7f4060155da0 2024-04-26T18:08:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60544/0 (socket says 172.21.15.12:60544) 2024-04-26T18:08:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 -- 172.21.15.12:0/1934400125 learned_addr learned my addr 172.21.15.12:0/1934400125 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405effd640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060155da0 0x7f4060153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405ffff640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 0x7f40601f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 -- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060155da0 msgr2=0x7f4060153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060155da0 0x7f4060153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 -- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 msgr2=0x7f40601f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 0x7f40601f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 -- 172.21.15.12:0/1934400125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4060068970 con 0x7f40600cd840 2024-04-26T18:08:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405ffff640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 0x7f40601f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:08:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f405f7fe640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f405000c490 tx=0x7f405000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050017070 con 0x7f40600cd840 2024-04-26T18:08:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4060154f10 con 0x7f40600cd840 2024-04-26T18:08:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40500052d0 con 0x7f40600cd840 2024-04-26T18:08:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050003830 con 0x7f40600cd840 2024-04-26T18:08:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.411+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40601554d0 con 0x7f40600cd840 2024-04-26T18:08:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.412+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4060076d20 con 0x7f40600cd840 2024-04-26T18:08:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.413+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f405001a070 con 0x7f40600cd840 2024-04-26T18:08:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.413+0000 7f4047fff640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.413+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f405008b320 con 0x7f40600cd840 2024-04-26T18:08:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.413+0000 7f405effd640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.414+0000 7f405effd640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4054034000 tx=0x7f405402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:35.431 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.418+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4050058cd0 con 0x7f40600cd840 2024-04-26T18:08:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.603+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40600d1230 con 0x7f404c06c920 2024-04-26T18:08:35.611 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.611+0000 7f4047fff640 1 -- 172.21.15.12:0/1934400125 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+336544 (secure 0 0 0) 0x7f40600d1230 con 0x7f404c06c920 2024-04-26T18:08:35.615 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:35.617 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:08:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 msgr2=0x7f404c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4054034000 tx=0x7f405402e000 comp rx=0 tx=0).stop 2024-04-26T18:08:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 msgr2=0x7f4060154880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f405000c490 tx=0x7f405000c950 comp rx=0 tx=0).stop 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 shutdown_connections 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f40601e4fd0 0x7f40601f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f404c06c920 0x7f404c06ede0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4060155da0 0x7f4060153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 --2- 172.21.15.12:0/1934400125 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40600cd840 0x7f4060154880 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.614+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 >> 172.21.15.12:0/1934400125 conn(0x7f4060068090 msgr2=0x7f406015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.615+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 shutdown_connections 2024-04-26T18:08:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:35.615+0000 7f40660f8640 1 -- 172.21.15.12:0/1934400125 wait complete. 2024-04-26T18:08:35.626 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-04-26T18:08:34.035572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188095347,"num_objects":10790,"num_object_clones":0,"num_object_copies":42852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10790,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30292,"num_write_kb":1787633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35694,"ondisk_log_size":35694,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3230424,"kb_used_data":2442456,"kb_used_omap":12,"kb_used_meta":787891,"kb_avail":751744296,"statfs":{"total":773094113280,"available":769786159104,"internally_reserved":0,"allocated":2501074944,"data_stored":2499308782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":806800944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51361795,"num_objects":2473,"num_object_clones":0,"num_object_copies":9866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2473,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2587,"num_write_kb":51756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003523"},"pg_stats":[{"pgid":"2.1f","version":"36'123","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.655962+0000","last_change":"2024-04-26T17:58:12.497254+0000","last_active":"2024-04-26T18:06:59.655962+0000","last_peered":"2024-04-26T18:06:59.655962+0000","last_clean":"2024-04-26T18:06:59.655962+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:06:59.655962+0000","last_undegraded":"2024-04-26T18:06:59.655962+0000","last_fullsized":"2024-04-26T18:06:59.655962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:32:14.749043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'92","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.564181+0000","last_change":"2024-04-26T18:03:24.967895+0000","last_active":"2024-04-26T18:08:28.564181+0000","last_peered":"2024-04-26T18:08:28.564181+0000","last_clean":"2024-04-26T18:08:28.564181+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:08:28.564181+0000","last_undegraded":"2024-04-26T18:08:28.564181+0000","last_fullsized":"2024-04-26T18:08:28.564181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:40.112811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.700846+0000","last_change":"2024-04-26T18:03:24.991152+0000","last_active":"2024-04-26T18:08:26.700846+0000","last_peered":"2024-04-26T18:08:26.700846+0000","last_clean":"2024-04-26T18:08:26.700846+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:26.700846+0000","last_undegraded":"2024-04-26T18:08:26.700846+0000","last_fullsized":"2024-04-26T18:08:26.700846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:03.026992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1624","reported_seq":1675,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.655650+0000","last_change":"2024-04-26T17:58:12.496349+0000","last_active":"2024-04-26T18:08:19.655650+0000","last_peered":"2024-04-26T18:08:19.655650+0000","last_clean":"2024-04-26T18:08:19.655650+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:19.655650+0000","last_undegraded":"2024-04-26T18:08:19.655650+0000","last_fullsized":"2024-04-26T18:08:19.655650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:13:12.734727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'87","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.552908+0000","last_change":"2024-04-26T18:03:25.006390+0000","last_active":"2024-04-26T18:08:28.552908+0000","last_peered":"2024-04-26T18:08:28.552908+0000","last_clean":"2024-04-26T18:08:28.552908+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:08:28.552908+0000","last_undegraded":"2024-04-26T18:08:28.552908+0000","last_fullsized":"2024-04-26T18:08:28.552908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:54:42.430689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2789,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678592+0000","last_change":"2024-04-26T18:03:24.654455+0000","last_active":"2024-04-26T18:08:26.678592+0000","last_peered":"2024-04-26T18:08:26.678592+0000","last_clean":"2024-04-26T18:08:26.678592+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:26.678592+0000","last_undegraded":"2024-04-26T18:08:26.678592+0000","last_fullsized":"2024-04-26T18:08:26.678592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:35:42.834932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'722","reported_seq":772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372121+0000","last_change":"2024-04-26T17:58:12.498450+0000","last_active":"2024-04-26T18:08:14.372121+0000","last_peered":"2024-04-26T18:08:14.372121+0000","last_clean":"2024-04-26T18:08:14.372121+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:14.372121+0000","last_undegraded":"2024-04-26T18:08:14.372121+0000","last_fullsized":"2024-04-26T18:08:14.372121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:52:26.568405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'91","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.557307+0000","last_change":"2024-04-26T18:03:24.642146+0000","last_active":"2024-04-26T18:08:28.557307+0000","last_peered":"2024-04-26T18:08:28.557307+0000","last_clean":"2024-04-26T18:08:28.557307+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:08:28.557307+0000","last_undegraded":"2024-04-26T18:08:28.557307+0000","last_fullsized":"2024-04-26T18:08:28.557307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:19:42.065227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2788,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.678605+0000","last_change":"2024-04-26T18:03:24.657679+0000","last_active":"2024-04-26T18:08:26.678605+0000","last_peered":"2024-04-26T18:08:26.678605+0000","last_clean":"2024-04-26T18:08:26.678605+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:26.678605+0000","last_undegraded":"2024-04-26T18:08:26.678605+0000","last_fullsized":"2024-04-26T18:08:26.678605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:45.442811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'165","reported_seq":215,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.603071+0000","last_change":"2024-04-26T17:58:12.497879+0000","last_active":"2024-04-26T18:08:19.603071+0000","last_peered":"2024-04-26T18:08:19.603071+0000","last_clean":"2024-04-26T18:08:19.603071+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:19.603071+0000","last_undegraded":"2024-04-26T18:08:19.603071+0000","last_fullsized":"2024-04-26T18:08:19.603071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:26.860641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'90","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.557915+0000","last_change":"2024-04-26T18:03:24.641061+0000","last_active":"2024-04-26T18:08:28.557915+0000","last_peered":"2024-04-26T18:08:28.557915+0000","last_clean":"2024-04-26T18:08:28.557915+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:08:28.557915+0000","last_undegraded":"2024-04-26T18:08:28.557915+0000","last_fullsized":"2024-04-26T18:08:28.557915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:45.214146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494273+0000","last_change":"2024-04-26T18:03:24.655979+0000","last_active":"2024-04-26T18:08:26.494273+0000","last_peered":"2024-04-26T18:08:26.494273+0000","last_clean":"2024-04-26T18:08:26.494273+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:26.494273+0000","last_undegraded":"2024-04-26T18:08:26.494273+0000","last_fullsized":"2024-04-26T18:08:26.494273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:59:20.235120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"36'88","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.562194+0000","last_change":"2024-04-26T18:03:24.635966+0000","last_active":"2024-04-26T18:08:28.562194+0000","last_peered":"2024-04-26T18:08:28.562194+0000","last_clean":"2024-04-26T18:08:28.562194+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:08:28.562194+0000","last_undegraded":"2024-04-26T18:08:28.562194+0000","last_fullsized":"2024-04-26T18:08:28.562194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:22:08.113204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'225","reported_seq":275,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:11.947542+0000","last_change":"2024-04-26T17:58:12.495926+0000","last_active":"2024-04-26T18:07:11.947542+0000","last_peered":"2024-04-26T18:07:11.947542+0000","last_clean":"2024-04-26T18:07:11.947542+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:07:11.947542+0000","last_undegraded":"2024-04-26T18:07:11.947542+0000","last_fullsized":"2024-04-26T18:07:11.947542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:50:26.306913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656882+0000","last_change":"2024-04-26T18:03:24.657047+0000","last_active":"2024-04-26T18:08:26.656882+0000","last_peered":"2024-04-26T18:08:26.656882+0000","last_clean":"2024-04-26T18:08:26.656882+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:26.656882+0000","last_undegraded":"2024-04-26T18:08:26.656882+0000","last_fullsized":"2024-04-26T18:08:26.656882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:12.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'88","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.556532+0000","last_change":"2024-04-26T18:03:24.972452+0000","last_active":"2024-04-26T18:08:28.556532+0000","last_peered":"2024-04-26T18:08:28.556532+0000","last_clean":"2024-04-26T18:08:28.556532+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:08:28.556532+0000","last_undegraded":"2024-04-26T18:08:28.556532+0000","last_fullsized":"2024-04-26T18:08:28.556532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:22.285266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'839","reported_seq":889,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:27.322728+0000","last_change":"2024-04-26T17:58:12.500837+0000","last_active":"2024-04-26T18:08:27.322728+0000","last_peered":"2024-04-26T18:08:27.322728+0000","last_clean":"2024-04-26T18:08:27.322728+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:08:27.322728+0000","last_undegraded":"2024-04-26T18:08:27.322728+0000","last_fullsized":"2024-04-26T18:08:27.322728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":839,"log_dups_size":0,"ondisk_log_size":839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:29.678286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.491409+0000","last_change":"2024-04-26T18:03:24.656810+0000","last_active":"2024-04-26T18:08:26.491409+0000","last_peered":"2024-04-26T18:08:26.491409+0000","last_clean":"2024-04-26T18:08:26.491409+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:26.491409+0000","last_undegraded":"2024-04-26T18:08:26.491409+0000","last_fullsized":"2024-04-26T18:08:26.491409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:58.022914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'94","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.551784+0000","last_change":"2024-04-26T18:03:24.996978+0000","last_active":"2024-04-26T18:08:28.551784+0000","last_peered":"2024-04-26T18:08:28.551784+0000","last_clean":"2024-04-26T18:08:28.551784+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:08:28.551784+0000","last_undegraded":"2024-04-26T18:08:28.551784+0000","last_fullsized":"2024-04-26T18:08:28.551784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:14:00.166776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'70","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:14.372832+0000","last_change":"2024-04-26T17:58:12.500715+0000","last_active":"2024-04-26T18:08:14.372832+0000","last_peered":"2024-04-26T18:08:14.372832+0000","last_clean":"2024-04-26T18:08:14.372832+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:14.372832+0000","last_undegraded":"2024-04-26T18:08:14.372832+0000","last_fullsized":"2024-04-26T18:08:14.372832+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:34:04.094828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2794,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640445+0000","last_change":"2024-04-26T18:03:24.748206+0000","last_active":"2024-04-26T18:08:26.640445+0000","last_peered":"2024-04-26T18:08:26.640445+0000","last_clean":"2024-04-26T18:08:26.640445+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:26.640445+0000","last_undegraded":"2024-04-26T18:08:26.640445+0000","last_fullsized":"2024-04-26T18:08:26.640445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:02:03.632839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'93","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.520794+0000","last_change":"2024-04-26T18:03:24.656039+0000","last_active":"2024-04-26T18:08:28.520794+0000","last_peered":"2024-04-26T18:08:28.520794+0000","last_clean":"2024-04-26T18:08:28.520794+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:08:28.520794+0000","last_undegraded":"2024-04-26T18:08:28.520794+0000","last_fullsized":"2024-04-26T18:08:28.520794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:46.594712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'7","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.755314+0000","last_change":"2024-04-26T17:58:12.499355+0000","last_active":"2024-04-26T18:06:59.755314+0000","last_peered":"2024-04-26T18:06:59.755314+0000","last_clean":"2024-04-26T18:06:59.755314+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:06:59.755314+0000","last_undegraded":"2024-04-26T18:06:59.755314+0000","last_fullsized":"2024-04-26T18:06:59.755314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:14.871665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2698,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.473190+0000","last_change":"2024-04-26T18:03:24.656487+0000","last_active":"2024-04-26T18:08:26.473190+0000","last_peered":"2024-04-26T18:08:26.473190+0000","last_clean":"2024-04-26T18:08:26.473190+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:26.473190+0000","last_undegraded":"2024-04-26T18:08:26.473190+0000","last_fullsized":"2024-04-26T18:08:26.473190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:09.597061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"36'93","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.554482+0000","last_change":"2024-04-26T18:03:25.006124+0000","last_active":"2024-04-26T18:08:28.554482+0000","last_peered":"2024-04-26T18:08:28.554482+0000","last_clean":"2024-04-26T18:08:28.554482+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:08:28.554482+0000","last_undegraded":"2024-04-26T18:08:28.554482+0000","last_fullsized":"2024-04-26T18:08:28.554482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:16:50.782589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'192","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:04:41.930694+0000","last_change":"2024-04-26T17:58:12.494896+0000","last_active":"2024-04-26T18:04:41.930694+0000","last_peered":"2024-04-26T18:04:41.930694+0000","last_clean":"2024-04-26T18:04:41.930694+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:04:41.930694+0000","last_undegraded":"2024-04-26T18:04:41.930694+0000","last_fullsized":"2024-04-26T18:04:41.930694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:52:29.170640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2799,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.633174+0000","last_change":"2024-04-26T18:03:24.655017+0000","last_active":"2024-04-26T18:08:26.633174+0000","last_peered":"2024-04-26T18:08:26.633174+0000","last_clean":"2024-04-26T18:08:26.633174+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:26.633174+0000","last_undegraded":"2024-04-26T18:08:26.633174+0000","last_fullsized":"2024-04-26T18:08:26.633174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:00:34.013964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'88","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.560167+0000","last_change":"2024-04-26T18:03:24.746543+0000","last_active":"2024-04-26T18:08:28.560167+0000","last_peered":"2024-04-26T18:08:28.560167+0000","last_clean":"2024-04-26T18:08:28.560167+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:08:28.560167+0000","last_undegraded":"2024-04-26T18:08:28.560167+0000","last_fullsized":"2024-04-26T18:08:28.560167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:44:51.534255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'261","reported_seq":311,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:27.978895+0000","last_change":"2024-04-26T17:58:12.500360+0000","last_active":"2024-04-26T18:08:27.978895+0000","last_peered":"2024-04-26T18:08:27.978895+0000","last_clean":"2024-04-26T18:08:27.978895+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:27.978895+0000","last_undegraded":"2024-04-26T18:08:27.978895+0000","last_fullsized":"2024-04-26T18:08:27.978895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:17:35.956802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2829,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.689970+0000","last_change":"2024-04-26T18:03:24.996787+0000","last_active":"2024-04-26T18:08:26.689970+0000","last_peered":"2024-04-26T18:08:26.689970+0000","last_clean":"2024-04-26T18:08:26.689970+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:26.689970+0000","last_undegraded":"2024-04-26T18:08:26.689970+0000","last_fullsized":"2024-04-26T18:08:26.689970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:02:51.053681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.539481+0000","last_change":"2024-04-26T18:03:24.747226+0000","last_active":"2024-04-26T18:08:28.539481+0000","last_peered":"2024-04-26T18:08:28.539481+0000","last_clean":"2024-04-26T18:08:28.539481+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:08:28.539481+0000","last_undegraded":"2024-04-26T18:08:28.539481+0000","last_fullsized":"2024-04-26T18:08:28.539481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:58:04.708780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'145","reported_seq":195,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:37.147385+0000","last_change":"2024-04-26T17:58:12.499078+0000","last_active":"2024-04-26T18:06:37.147385+0000","last_peered":"2024-04-26T18:06:37.147385+0000","last_clean":"2024-04-26T18:06:37.147385+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:06:37.147385+0000","last_undegraded":"2024-04-26T18:06:37.147385+0000","last_fullsized":"2024-04-26T18:06:37.147385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:20:58.999671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.331133+0000","last_change":"2024-04-26T18:03:25.011835+0000","last_active":"2024-04-26T18:08:26.331133+0000","last_peered":"2024-04-26T18:08:26.331133+0000","last_clean":"2024-04-26T18:08:26.331133+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:26.331133+0000","last_undegraded":"2024-04-26T18:08:26.331133+0000","last_fullsized":"2024-04-26T18:08:26.331133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:12:45.743889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'84","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.551710+0000","last_change":"2024-04-26T18:03:24.641851+0000","last_active":"2024-04-26T18:08:28.551710+0000","last_peered":"2024-04-26T18:08:28.551710+0000","last_clean":"2024-04-26T18:08:28.551710+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:08:28.551710+0000","last_undegraded":"2024-04-26T18:08:28.551710+0000","last_fullsized":"2024-04-26T18:08:28.551710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:38:05.076764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'132","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602929+0000","last_change":"2024-04-26T17:58:12.499679+0000","last_active":"2024-04-26T18:08:19.602929+0000","last_peered":"2024-04-26T18:08:19.602929+0000","last_clean":"2024-04-26T18:08:19.602929+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:19.602929+0000","last_undegraded":"2024-04-26T18:08:19.602929+0000","last_fullsized":"2024-04-26T18:08:19.602929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:00:19.163283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.532024+0000","last_change":"2024-04-26T18:03:24.748734+0000","last_active":"2024-04-26T18:08:26.532024+0000","last_peered":"2024-04-26T18:08:26.532024+0000","last_clean":"2024-04-26T18:08:26.532024+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:26.532024+0000","last_undegraded":"2024-04-26T18:08:26.532024+0000","last_fullsized":"2024-04-26T18:08:26.532024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:29:50.548538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'96","reported_seq":2165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.541059+0000","last_change":"2024-04-26T18:03:24.657308+0000","last_active":"2024-04-26T18:08:28.541059+0000","last_peered":"2024-04-26T18:08:28.541059+0000","last_clean":"2024-04-26T18:08:28.541059+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:08:28.541059+0000","last_undegraded":"2024-04-26T18:08:28.541059+0000","last_fullsized":"2024-04-26T18:08:28.541059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:50.688884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'10","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.654871+0000","last_change":"2024-04-26T17:58:12.499067+0000","last_active":"2024-04-26T18:06:59.654871+0000","last_peered":"2024-04-26T18:06:59.654871+0000","last_clean":"2024-04-26T18:06:59.654871+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:06:59.654871+0000","last_undegraded":"2024-04-26T18:06:59.654871+0000","last_fullsized":"2024-04-26T18:06:59.654871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:53:37.217680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2738,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.524101+0000","last_change":"2024-04-26T18:03:24.747715+0000","last_active":"2024-04-26T18:08:26.524101+0000","last_peered":"2024-04-26T18:08:26.524101+0000","last_clean":"2024-04-26T18:08:26.524101+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:26.524101+0000","last_undegraded":"2024-04-26T18:08:26.524101+0000","last_fullsized":"2024-04-26T18:08:26.524101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:46:59.495568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"36'83","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.538102+0000","last_change":"2024-04-26T18:03:24.749179+0000","last_active":"2024-04-26T18:08:28.538102+0000","last_peered":"2024-04-26T18:08:28.538102+0000","last_clean":"2024-04-26T18:08:28.538102+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:08:28.538102+0000","last_undegraded":"2024-04-26T18:08:28.538102+0000","last_fullsized":"2024-04-26T18:08:28.538102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:09:10.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'124","reported_seq":294,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.718532+0000","last_change":"2024-04-26T17:58:12.494491+0000","last_active":"2024-04-26T18:06:45.718532+0000","last_peered":"2024-04-26T18:06:45.718532+0000","last_clean":"2024-04-26T18:06:45.718532+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:06:45.718532+0000","last_undegraded":"2024-04-26T18:06:45.718532+0000","last_fullsized":"2024-04-26T18:06:45.718532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:59:16.396826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2744,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.640670+0000","last_change":"2024-04-26T18:03:24.748508+0000","last_active":"2024-04-26T18:08:26.640670+0000","last_peered":"2024-04-26T18:08:26.640670+0000","last_clean":"2024-04-26T18:08:26.640670+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:26.640670+0000","last_undegraded":"2024-04-26T18:08:26.640670+0000","last_fullsized":"2024-04-26T18:08:26.640670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:08:50.836401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"36'82","reported_seq":2151,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.558963+0000","last_change":"2024-04-26T18:03:25.001751+0000","last_active":"2024-04-26T18:08:28.558963+0000","last_peered":"2024-04-26T18:08:28.558963+0000","last_clean":"2024-04-26T18:08:28.558963+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:08:28.558963+0000","last_undegraded":"2024-04-26T18:08:28.558963+0000","last_fullsized":"2024-04-26T18:08:28.558963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:28:39.691375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'250","reported_seq":301,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:11.941507+0000","last_change":"2024-04-26T17:58:12.501409+0000","last_active":"2024-04-26T18:06:11.941507+0000","last_peered":"2024-04-26T18:06:11.941507+0000","last_clean":"2024-04-26T18:06:11.941507+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:06:11.941507+0000","last_undegraded":"2024-04-26T18:06:11.941507+0000","last_fullsized":"2024-04-26T18:06:11.941507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:28:12.454691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.494713+0000","last_change":"2024-04-26T18:03:25.005985+0000","last_active":"2024-04-26T18:08:26.494713+0000","last_peered":"2024-04-26T18:08:26.494713+0000","last_clean":"2024-04-26T18:08:26.494713+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:26.494713+0000","last_undegraded":"2024-04-26T18:08:26.494713+0000","last_fullsized":"2024-04-26T18:08:26.494713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:40:46.423765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.560793+0000","last_change":"2024-04-26T18:03:24.984011+0000","last_active":"2024-04-26T18:08:28.560793+0000","last_peered":"2024-04-26T18:08:28.560793+0000","last_clean":"2024-04-26T18:08:28.560793+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:08:28.560793+0000","last_undegraded":"2024-04-26T18:08:28.560793+0000","last_fullsized":"2024-04-26T18:08:28.560793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:09.171009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'113","reported_seq":162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:31.943358+0000","last_change":"2024-04-26T17:58:12.496131+0000","last_active":"2024-04-26T18:06:31.943358+0000","last_peered":"2024-04-26T18:06:31.943358+0000","last_clean":"2024-04-26T18:06:31.943358+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:06:31.943358+0000","last_undegraded":"2024-04-26T18:06:31.943358+0000","last_fullsized":"2024-04-26T18:06:31.943358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:36.432541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:06.941024+0000","last_change":"2024-04-26T17:58:03.019130+0000","last_active":"2024-04-26T18:06:06.941024+0000","last_peered":"2024-04-26T18:06:06.941024+0000","last_clean":"2024-04-26T18:06:06.941024+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:06:06.941024+0000","last_undegraded":"2024-04-26T18:06:06.941024+0000","last_fullsized":"2024-04-26T18:06:06.941024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:02.006207+0000","last_clean_scrub_stamp":"2024-04-26T17:58:02.006207+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:30:33.219996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.315128+0000","last_change":"2024-04-26T18:03:24.635471+0000","last_active":"2024-04-26T18:08:26.315128+0000","last_peered":"2024-04-26T18:08:26.315128+0000","last_clean":"2024-04-26T18:08:26.315128+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:26.315128+0000","last_undegraded":"2024-04-26T18:08:26.315128+0000","last_fullsized":"2024-04-26T18:08:26.315128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:46:03.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"36'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.561003+0000","last_change":"2024-04-26T18:03:24.944311+0000","last_active":"2024-04-26T18:08:28.561003+0000","last_peered":"2024-04-26T18:08:28.561003+0000","last_clean":"2024-04-26T18:08:28.561003+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:08:28.561003+0000","last_undegraded":"2024-04-26T18:08:28.561003+0000","last_fullsized":"2024-04-26T18:08:28.561003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:09:11.446948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'339","reported_seq":389,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.895454+0000","last_change":"2024-04-26T17:58:12.497109+0000","last_active":"2024-04-26T18:08:18.895454+0000","last_peered":"2024-04-26T18:08:18.895454+0000","last_clean":"2024-04-26T18:08:18.895454+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:18.895454+0000","last_undegraded":"2024-04-26T18:08:18.895454+0000","last_fullsized":"2024-04-26T18:08:18.895454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:15:28.603541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2790,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.275515+0000","last_change":"2024-04-26T18:03:24.636889+0000","last_active":"2024-04-26T18:08:26.275515+0000","last_peered":"2024-04-26T18:08:26.275515+0000","last_clean":"2024-04-26T18:08:26.275515+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:26.275515+0000","last_undegraded":"2024-04-26T18:08:26.275515+0000","last_fullsized":"2024-04-26T18:08:26.275515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:57.257654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'96","reported_seq":2164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.550994+0000","last_change":"2024-04-26T18:03:24.642373+0000","last_active":"2024-04-26T18:08:28.550994+0000","last_peered":"2024-04-26T18:08:28.550994+0000","last_clean":"2024-04-26T18:08:28.550994+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:08:28.550994+0000","last_undegraded":"2024-04-26T18:08:28.550994+0000","last_fullsized":"2024-04-26T18:08:28.550994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:13:50.494058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'11","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:23.319192+0000","last_change":"2024-04-26T17:58:12.498120+0000","last_active":"2024-04-26T18:08:23.319192+0000","last_peered":"2024-04-26T18:08:23.319192+0000","last_clean":"2024-04-26T18:08:23.319192+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:23.319192+0000","last_undegraded":"2024-04-26T18:08:23.319192+0000","last_fullsized":"2024-04-26T18:08:23.319192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:53:43.231301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2762,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.339174+0000","last_change":"2024-04-26T18:03:25.011325+0000","last_active":"2024-04-26T18:08:26.339174+0000","last_peered":"2024-04-26T18:08:26.339174+0000","last_clean":"2024-04-26T18:08:26.339174+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:26.339174+0000","last_undegraded":"2024-04-26T18:08:26.339174+0000","last_fullsized":"2024-04-26T18:08:26.339174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:23:28.586899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"36'87","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.558828+0000","last_change":"2024-04-26T18:03:24.946369+0000","last_active":"2024-04-26T18:08:28.558828+0000","last_peered":"2024-04-26T18:08:28.558828+0000","last_clean":"2024-04-26T18:08:28.558828+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:08:28.558828+0000","last_undegraded":"2024-04-26T18:08:28.558828+0000","last_fullsized":"2024-04-26T18:08:28.558828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:19:17.852091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'114","reported_seq":164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:18.484515+0000","last_change":"2024-04-26T17:58:12.494680+0000","last_active":"2024-04-26T18:08:18.484515+0000","last_peered":"2024-04-26T18:08:18.484515+0000","last_clean":"2024-04-26T18:08:18.484515+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:18.484515+0000","last_undegraded":"2024-04-26T18:08:18.484515+0000","last_fullsized":"2024-04-26T18:08:18.484515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:56:06.068795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2772,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.245217+0000","last_change":"2024-04-26T18:03:24.635236+0000","last_active":"2024-04-26T18:08:26.245217+0000","last_peered":"2024-04-26T18:08:26.245217+0000","last_clean":"2024-04-26T18:08:26.245217+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:26.245217+0000","last_undegraded":"2024-04-26T18:08:26.245217+0000","last_fullsized":"2024-04-26T18:08:26.245217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:55:48.980355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'66","reported_seq":2135,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.559628+0000","last_change":"2024-04-26T18:03:24.944998+0000","last_active":"2024-04-26T18:08:28.559628+0000","last_peered":"2024-04-26T18:08:28.559628+0000","last_clean":"2024-04-26T18:08:28.559628+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:08:28.559628+0000","last_undegraded":"2024-04-26T18:08:28.559628+0000","last_fullsized":"2024-04-26T18:08:28.559628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:38:30.416363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'61","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:59.756283+0000","last_change":"2024-04-26T17:58:12.493760+0000","last_active":"2024-04-26T18:06:59.756283+0000","last_peered":"2024-04-26T18:06:59.756283+0000","last_clean":"2024-04-26T18:06:59.756283+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:06:59.756283+0000","last_undegraded":"2024-04-26T18:06:59.756283+0000","last_fullsized":"2024-04-26T18:06:59.756283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:01:07.186554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2819,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.652003+0000","last_change":"2024-04-26T18:03:24.655394+0000","last_active":"2024-04-26T18:08:26.652003+0000","last_peered":"2024-04-26T18:08:26.652003+0000","last_clean":"2024-04-26T18:08:26.652003+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:26.652003+0000","last_undegraded":"2024-04-26T18:08:26.652003+0000","last_fullsized":"2024-04-26T18:08:26.652003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:04.461317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.559078+0000","last_change":"2024-04-26T18:03:24.943633+0000","last_active":"2024-04-26T18:08:28.559078+0000","last_peered":"2024-04-26T18:08:28.559078+0000","last_clean":"2024-04-26T18:08:28.559078+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:08:28.559078+0000","last_undegraded":"2024-04-26T18:08:28.559078+0000","last_fullsized":"2024-04-26T18:08:28.559078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:48:39.290525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'72","reported_seq":122,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949117+0000","last_change":"2024-04-26T17:58:12.501662+0000","last_active":"2024-04-26T18:07:31.949117+0000","last_peered":"2024-04-26T18:07:31.949117+0000","last_clean":"2024-04-26T18:07:31.949117+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:07:31.949117+0000","last_undegraded":"2024-04-26T18:07:31.949117+0000","last_fullsized":"2024-04-26T18:07:31.949117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:07.279395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2765,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.500056+0000","last_change":"2024-04-26T18:03:25.006200+0000","last_active":"2024-04-26T18:08:26.500056+0000","last_peered":"2024-04-26T18:08:26.500056+0000","last_clean":"2024-04-26T18:08:26.500056+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:26.500056+0000","last_undegraded":"2024-04-26T18:08:26.500056+0000","last_fullsized":"2024-04-26T18:08:26.500056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:31:04.984283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'88","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.546834+0000","last_change":"2024-04-26T18:03:24.636576+0000","last_active":"2024-04-26T18:08:28.546834+0000","last_peered":"2024-04-26T18:08:28.546834+0000","last_clean":"2024-04-26T18:08:28.546834+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:08:28.546834+0000","last_undegraded":"2024-04-26T18:08:28.546834+0000","last_fullsized":"2024-04-26T18:08:28.546834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:01.614026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949842+0000","last_change":"2024-04-26T17:58:12.689393+0000","last_active":"2024-04-26T18:07:31.949842+0000","last_peered":"2024-04-26T18:07:31.949842+0000","last_clean":"2024-04-26T18:07:31.949842+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:07:31.949842+0000","last_undegraded":"2024-04-26T18:07:31.949842+0000","last_fullsized":"2024-04-26T18:07:31.949842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:04:32.069355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2757,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.656750+0000","last_change":"2024-04-26T18:03:24.989125+0000","last_active":"2024-04-26T18:08:26.656750+0000","last_peered":"2024-04-26T18:08:26.656750+0000","last_clean":"2024-04-26T18:08:26.656750+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:26.656750+0000","last_undegraded":"2024-04-26T18:08:26.656750+0000","last_fullsized":"2024-04-26T18:08:26.656750+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:09:28.355140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'101","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.559287+0000","last_change":"2024-04-26T18:03:24.926906+0000","last_active":"2024-04-26T18:08:28.559287+0000","last_peered":"2024-04-26T18:08:28.559287+0000","last_clean":"2024-04-26T18:08:28.559287+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:08:28.559287+0000","last_undegraded":"2024-04-26T18:08:28.559287+0000","last_fullsized":"2024-04-26T18:08:28.559287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:41:00.232054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:05:11.934972+0000","last_change":"2024-04-26T17:58:12.494811+0000","last_active":"2024-04-26T18:05:11.934972+0000","last_peered":"2024-04-26T18:05:11.934972+0000","last_clean":"2024-04-26T18:05:11.934972+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:05:11.934972+0000","last_undegraded":"2024-04-26T18:05:11.934972+0000","last_fullsized":"2024-04-26T18:05:11.934972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:12:20.463866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2700,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.659323+0000","last_change":"2024-04-26T18:03:24.996245+0000","last_active":"2024-04-26T18:08:26.659323+0000","last_peered":"2024-04-26T18:08:26.659323+0000","last_clean":"2024-04-26T18:08:26.659323+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:26.659323+0000","last_undegraded":"2024-04-26T18:08:26.659323+0000","last_fullsized":"2024-04-26T18:08:26.659323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:42:47.633142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.556278+0000","last_change":"2024-04-26T18:03:25.010829+0000","last_active":"2024-04-26T18:08:28.556278+0000","last_peered":"2024-04-26T18:08:28.556278+0000","last_clean":"2024-04-26T18:08:28.556278+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:08:28.556278+0000","last_undegraded":"2024-04-26T18:08:28.556278+0000","last_fullsized":"2024-04-26T18:08:28.556278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:43.796963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'14","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:31.949215+0000","last_change":"2024-04-26T17:58:12.496508+0000","last_active":"2024-04-26T18:07:31.949215+0000","last_peered":"2024-04-26T18:07:31.949215+0000","last_clean":"2024-04-26T18:07:31.949215+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:07:31.949215+0000","last_undegraded":"2024-04-26T18:07:31.949215+0000","last_fullsized":"2024-04-26T18:07:31.949215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:39:18.181964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2749,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.079545+0000","last_change":"2024-04-26T18:03:24.641376+0000","last_active":"2024-04-26T18:08:26.079545+0000","last_peered":"2024-04-26T18:08:26.079545+0000","last_clean":"2024-04-26T18:08:26.079545+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:26.079545+0000","last_undegraded":"2024-04-26T18:08:26.079545+0000","last_fullsized":"2024-04-26T18:08:26.079545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:05:20.839796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.555432+0000","last_change":"2024-04-26T18:03:24.944051+0000","last_active":"2024-04-26T18:08:28.555432+0000","last_peered":"2024-04-26T18:08:28.555432+0000","last_clean":"2024-04-26T18:08:28.555432+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:08:28.555432+0000","last_undegraded":"2024-04-26T18:08:28.555432+0000","last_fullsized":"2024-04-26T18:08:28.555432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:20:10.353238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'158","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:22.301921+0000","last_change":"2024-04-26T17:58:12.492218+0000","last_active":"2024-04-26T18:08:22.301921+0000","last_peered":"2024-04-26T18:08:22.301921+0000","last_clean":"2024-04-26T18:08:22.301921+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:22.301921+0000","last_undegraded":"2024-04-26T18:08:22.301921+0000","last_fullsized":"2024-04-26T18:08:22.301921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:08.082285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":157,"num_write_kb":12429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.519720+0000","last_change":"2024-04-26T18:03:24.748793+0000","last_active":"2024-04-26T18:08:26.519720+0000","last_peered":"2024-04-26T18:08:26.519720+0000","last_clean":"2024-04-26T18:08:26.519720+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:26.519720+0000","last_undegraded":"2024-04-26T18:08:26.519720+0000","last_fullsized":"2024-04-26T18:08:26.519720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:00:23.947294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.552691+0000","last_change":"2024-04-26T18:03:24.657577+0000","last_active":"2024-04-26T18:08:28.552691+0000","last_peered":"2024-04-26T18:08:28.552691+0000","last_clean":"2024-04-26T18:08:28.552691+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:08:28.552691+0000","last_undegraded":"2024-04-26T18:08:28.552691+0000","last_fullsized":"2024-04-26T18:08:28.552691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:31:58.858205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'334","reported_seq":384,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.326258+0000","last_change":"2024-04-26T17:58:12.501077+0000","last_active":"2024-04-26T18:08:28.326258+0000","last_peered":"2024-04-26T18:08:28.326258+0000","last_clean":"2024-04-26T18:08:28.326258+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:28.326258+0000","last_undegraded":"2024-04-26T18:08:28.326258+0000","last_fullsized":"2024-04-26T18:08:28.326258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":334,"log_dups_size":0,"ondisk_log_size":334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:53:56.453026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":12535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2771,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.664399+0000","last_change":"2024-04-26T18:03:24.657947+0000","last_active":"2024-04-26T18:08:26.664399+0000","last_peered":"2024-04-26T18:08:26.664399+0000","last_clean":"2024-04-26T18:08:26.664399+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:26.664399+0000","last_undegraded":"2024-04-26T18:08:26.664399+0000","last_fullsized":"2024-04-26T18:08:26.664399+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:46:26.337195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'89","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.552678+0000","last_change":"2024-04-26T18:03:25.007674+0000","last_active":"2024-04-26T18:08:28.552678+0000","last_peered":"2024-04-26T18:08:28.552678+0000","last_clean":"2024-04-26T18:08:28.552678+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:08:28.552678+0000","last_undegraded":"2024-04-26T18:08:28.552678+0000","last_fullsized":"2024-04-26T18:08:28.552678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:10:01.233904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'591","reported_seq":640,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:19.602792+0000","last_change":"2024-04-26T17:58:12.491268+0000","last_active":"2024-04-26T18:08:19.602792+0000","last_peered":"2024-04-26T18:08:19.602792+0000","last_clean":"2024-04-26T18:08:19.602792+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:19.602792+0000","last_undegraded":"2024-04-26T18:08:19.602792+0000","last_fullsized":"2024-04-26T18:08:19.602792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:49:00.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2807,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.680572+0000","last_change":"2024-04-26T18:03:24.997268+0000","last_active":"2024-04-26T18:08:26.680572+0000","last_peered":"2024-04-26T18:08:26.680572+0000","last_clean":"2024-04-26T18:08:26.680572+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:26.680572+0000","last_undegraded":"2024-04-26T18:08:26.680572+0000","last_fullsized":"2024-04-26T18:08:26.680572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:53.318883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'105","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.553184+0000","last_change":"2024-04-26T18:03:24.849449+0000","last_active":"2024-04-26T18:08:28.553184+0000","last_peered":"2024-04-26T18:08:28.553184+0000","last_clean":"2024-04-26T18:08:28.553184+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:08:28.553184+0000","last_undegraded":"2024-04-26T18:08:28.553184+0000","last_fullsized":"2024-04-26T18:08:28.553184+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:00.389514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'4","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:51.952068+0000","last_change":"2024-04-26T17:58:12.496700+0000","last_active":"2024-04-26T18:07:51.952068+0000","last_peered":"2024-04-26T18:07:51.952068+0000","last_clean":"2024-04-26T18:07:51.952068+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:07:51.952068+0000","last_undegraded":"2024-04-26T18:07:51.952068+0000","last_fullsized":"2024-04-26T18:07:51.952068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:19.688101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2805,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.708112+0000","last_change":"2024-04-26T18:03:24.993538+0000","last_active":"2024-04-26T18:08:26.708112+0000","last_peered":"2024-04-26T18:08:26.708112+0000","last_clean":"2024-04-26T18:08:26.708112+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:26.708112+0000","last_undegraded":"2024-04-26T18:08:26.708112+0000","last_fullsized":"2024-04-26T18:08:26.708112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:53:29.893910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.493317+0000","last_change":"2024-04-26T18:03:25.003948+0000","last_active":"2024-04-26T18:08:26.493317+0000","last_peered":"2024-04-26T18:08:26.493317+0000","last_clean":"2024-04-26T18:08:26.493317+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:26.493317+0000","last_undegraded":"2024-04-26T18:08:26.493317+0000","last_fullsized":"2024-04-26T18:08:26.493317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:07.242676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'93","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.553040+0000","last_change":"2024-04-26T18:03:24.746669+0000","last_active":"2024-04-26T18:08:28.553040+0000","last_peered":"2024-04-26T18:08:28.553040+0000","last_clean":"2024-04-26T18:08:28.553040+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:08:28.553040+0000","last_undegraded":"2024-04-26T18:08:28.553040+0000","last_fullsized":"2024-04-26T18:08:28.553040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:52:09.392232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'56","reported_seq":105,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.679225+0000","last_change":"2024-04-26T17:58:12.494649+0000","last_active":"2024-04-26T18:08:26.679225+0000","last_peered":"2024-04-26T18:08:26.679225+0000","last_clean":"2024-04-26T18:08:26.679225+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:26.679225+0000","last_undegraded":"2024-04-26T18:08:26.679225+0000","last_fullsized":"2024-04-26T18:08:26.679225+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:45:39.273665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2758,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.433695+0000","last_change":"2024-04-26T18:03:24.635733+0000","last_active":"2024-04-26T18:08:26.433695+0000","last_peered":"2024-04-26T18:08:26.433695+0000","last_clean":"2024-04-26T18:08:26.433695+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:26.433695+0000","last_undegraded":"2024-04-26T18:08:26.433695+0000","last_fullsized":"2024-04-26T18:08:26.433695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:51:06.120357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'110","reported_seq":2179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.556596+0000","last_change":"2024-04-26T18:03:24.995053+0000","last_active":"2024-04-26T18:08:28.556596+0000","last_peered":"2024-04-26T18:08:28.556596+0000","last_clean":"2024-04-26T18:08:28.556596+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:08:28.556596+0000","last_undegraded":"2024-04-26T18:08:28.556596+0000","last_fullsized":"2024-04-26T18:08:28.556596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:55.950269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'26","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:07:52.001657+0000","last_change":"2024-04-26T17:58:12.490655+0000","last_active":"2024-04-26T18:07:52.001657+0000","last_peered":"2024-04-26T18:07:52.001657+0000","last_clean":"2024-04-26T18:07:52.001657+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:07:52.001657+0000","last_undegraded":"2024-04-26T18:07:52.001657+0000","last_fullsized":"2024-04-26T18:07:52.001657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:45:28.071182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1481","reported_seq":1531,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:29.561440+0000","last_change":"2024-04-26T17:58:12.689371+0000","last_active":"2024-04-26T18:08:29.561440+0000","last_peered":"2024-04-26T18:08:29.561440+0000","last_clean":"2024-04-26T18:08:29.561440+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:08:29.561440+0000","last_undegraded":"2024-04-26T18:08:29.561440+0000","last_fullsized":"2024-04-26T18:08:29.561440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":1481,"log_dups_size":0,"ondisk_log_size":1481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:14.015171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19075995,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":19724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'91","reported_seq":2160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.559825+0000","last_change":"2024-04-26T18:03:25.011524+0000","last_active":"2024-04-26T18:08:28.559825+0000","last_peered":"2024-04-26T18:08:28.559825+0000","last_clean":"2024-04-26T18:08:28.559825+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:08:28.559825+0000","last_undegraded":"2024-04-26T18:08:28.559825+0000","last_fullsized":"2024-04-26T18:08:28.559825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:07:37.329300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2733,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.084785+0000","last_change":"2024-04-26T18:03:24.855578+0000","last_active":"2024-04-26T18:08:26.084785+0000","last_peered":"2024-04-26T18:08:26.084785+0000","last_clean":"2024-04-26T18:08:26.084785+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:26.084785+0000","last_undegraded":"2024-04-26T18:08:26.084785+0000","last_fullsized":"2024-04-26T18:08:26.084785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:15:11.993735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'53","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:06:45.720705+0000","last_change":"2024-04-26T17:58:12.494827+0000","last_active":"2024-04-26T18:06:45.720705+0000","last_peered":"2024-04-26T18:06:45.720705+0000","last_clean":"2024-04-26T18:06:45.720705+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:06:45.720705+0000","last_undegraded":"2024-04-26T18:06:45.720705+0000","last_fullsized":"2024-04-26T18:06:45.720705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:11.463644+0000","last_clean_scrub_stamp":"2024-04-26T17:58:11.463644+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:57.566934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.539764+0000","last_change":"2024-04-26T18:03:24.655256+0000","last_active":"2024-04-26T18:08:28.539764+0000","last_peered":"2024-04-26T18:08:28.539764+0000","last_clean":"2024-04-26T18:08:28.539764+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:08:28.539764+0000","last_undegraded":"2024-04-26T18:08:28.539764+0000","last_fullsized":"2024-04-26T18:08:28.539764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:10.999130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2760,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.582954+0000","last_change":"2024-04-26T18:03:24.995728+0000","last_active":"2024-04-26T18:08:26.582954+0000","last_peered":"2024-04-26T18:08:26.582954+0000","last_clean":"2024-04-26T18:08:26.582954+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:26.582954+0000","last_undegraded":"2024-04-26T18:08:26.582954+0000","last_fullsized":"2024-04-26T18:08:26.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:39:59.292898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'107","reported_seq":2176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.560933+0000","last_change":"2024-04-26T18:03:24.635879+0000","last_active":"2024-04-26T18:08:28.560933+0000","last_peered":"2024-04-26T18:08:28.560933+0000","last_clean":"2024-04-26T18:08:28.560933+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:08:28.560933+0000","last_undegraded":"2024-04-26T18:08:28.560933+0000","last_fullsized":"2024-04-26T18:08:28.560933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:55:59.542460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"36'110","reported_seq":2179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.555231+0000","last_change":"2024-04-26T18:03:24.853558+0000","last_active":"2024-04-26T18:08:28.555231+0000","last_peered":"2024-04-26T18:08:28.555231+0000","last_clean":"2024-04-26T18:08:28.555231+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:08:28.555231+0000","last_undegraded":"2024-04-26T18:08:28.555231+0000","last_fullsized":"2024-04-26T18:08:28.555231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:00:25.997781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'102","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.546861+0000","last_change":"2024-04-26T18:03:24.642154+0000","last_active":"2024-04-26T18:08:28.546861+0000","last_peered":"2024-04-26T18:08:28.546861+0000","last_clean":"2024-04-26T18:08:28.546861+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:08:28.546861+0000","last_undegraded":"2024-04-26T18:08:28.546861+0000","last_fullsized":"2024-04-26T18:08:28.546861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:42:50.872113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"36'99","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.554396+0000","last_change":"2024-04-26T18:03:25.011221+0000","last_active":"2024-04-26T18:08:28.554396+0000","last_peered":"2024-04-26T18:08:28.554396+0000","last_clean":"2024-04-26T18:08:28.554396+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:08:28.554396+0000","last_undegraded":"2024-04-26T18:08:28.554396+0000","last_fullsized":"2024-04-26T18:08:28.554396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:48:00.133637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'79","reported_seq":2148,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.551863+0000","last_change":"2024-04-26T18:03:24.996541+0000","last_active":"2024-04-26T18:08:28.551863+0000","last_peered":"2024-04-26T18:08:28.551863+0000","last_clean":"2024-04-26T18:08:28.551863+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:08:28.551863+0000","last_undegraded":"2024-04-26T18:08:28.551863+0000","last_fullsized":"2024-04-26T18:08:28.551863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:34:21.848231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'74","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.550898+0000","last_change":"2024-04-26T18:03:24.748158+0000","last_active":"2024-04-26T18:08:28.550898+0000","last_peered":"2024-04-26T18:08:28.550898+0000","last_clean":"2024-04-26T18:08:28.550898+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:08:28.550898+0000","last_undegraded":"2024-04-26T18:08:28.550898+0000","last_fullsized":"2024-04-26T18:08:28.550898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:00:22.736661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"36'109","reported_seq":2178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.563034+0000","last_change":"2024-04-26T18:03:24.637015+0000","last_active":"2024-04-26T18:08:28.563034+0000","last_peered":"2024-04-26T18:08:28.563034+0000","last_clean":"2024-04-26T18:08:28.563034+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:08:28.563034+0000","last_undegraded":"2024-04-26T18:08:28.563034+0000","last_fullsized":"2024-04-26T18:08:28.563034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:03:53.689201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'83","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.544960+0000","last_change":"2024-04-26T18:03:24.988961+0000","last_active":"2024-04-26T18:08:28.544960+0000","last_peered":"2024-04-26T18:08:28.544960+0000","last_clean":"2024-04-26T18:08:28.544960+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:08:28.544960+0000","last_undegraded":"2024-04-26T18:08:28.544960+0000","last_fullsized":"2024-04-26T18:08:28.544960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:10:44.663355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'91","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.546443+0000","last_change":"2024-04-26T18:03:24.637315+0000","last_active":"2024-04-26T18:08:28.546443+0000","last_peered":"2024-04-26T18:08:28.546443+0000","last_clean":"2024-04-26T18:08:28.546443+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:08:28.546443+0000","last_undegraded":"2024-04-26T18:08:28.546443+0000","last_fullsized":"2024-04-26T18:08:28.546443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:48:28.067247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"36'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.553262+0000","last_change":"2024-04-26T18:03:24.989182+0000","last_active":"2024-04-26T18:08:28.553262+0000","last_peered":"2024-04-26T18:08:28.553262+0000","last_clean":"2024-04-26T18:08:28.553262+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:08:28.553262+0000","last_undegraded":"2024-04-26T18:08:28.553262+0000","last_fullsized":"2024-04-26T18:08:28.553262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:08:40.391182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'95","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.553120+0000","last_change":"2024-04-26T18:03:24.852287+0000","last_active":"2024-04-26T18:08:28.553120+0000","last_peered":"2024-04-26T18:08:28.553120+0000","last_clean":"2024-04-26T18:08:28.553120+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:08:28.553120+0000","last_undegraded":"2024-04-26T18:08:28.553120+0000","last_fullsized":"2024-04-26T18:08:28.553120+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:37:31.793462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.559546+0000","last_change":"2024-04-26T18:03:25.009931+0000","last_active":"2024-04-26T18:08:28.559546+0000","last_peered":"2024-04-26T18:08:28.559546+0000","last_clean":"2024-04-26T18:08:28.559546+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:08:28.559546+0000","last_undegraded":"2024-04-26T18:08:28.559546+0000","last_fullsized":"2024-04-26T18:08:28.559546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:27:15.705947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'98","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.555868+0000","last_change":"2024-04-26T18:03:24.637292+0000","last_active":"2024-04-26T18:08:28.555868+0000","last_peered":"2024-04-26T18:08:28.555868+0000","last_clean":"2024-04-26T18:08:28.555868+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:08:28.555868+0000","last_undegraded":"2024-04-26T18:08:28.555868+0000","last_fullsized":"2024-04-26T18:08:28.555868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:27.406729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.554582+0000","last_change":"2024-04-26T18:03:24.944245+0000","last_active":"2024-04-26T18:08:28.554582+0000","last_peered":"2024-04-26T18:08:28.554582+0000","last_clean":"2024-04-26T18:08:28.554582+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:08:28.554582+0000","last_undegraded":"2024-04-26T18:08:28.554582+0000","last_fullsized":"2024-04-26T18:08:28.554582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:22:06.577309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"36'88","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.560601+0000","last_change":"2024-04-26T18:03:24.851534+0000","last_active":"2024-04-26T18:08:28.560601+0000","last_peered":"2024-04-26T18:08:28.560601+0000","last_clean":"2024-04-26T18:08:28.560601+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:08:28.560601+0000","last_undegraded":"2024-04-26T18:08:28.560601+0000","last_fullsized":"2024-04-26T18:08:28.560601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:01:49.815792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'94","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.558183+0000","last_change":"2024-04-26T18:03:24.642437+0000","last_active":"2024-04-26T18:08:28.558183+0000","last_peered":"2024-04-26T18:08:28.558183+0000","last_clean":"2024-04-26T18:08:28.558183+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:08:28.558183+0000","last_undegraded":"2024-04-26T18:08:28.558183+0000","last_fullsized":"2024-04-26T18:08:28.558183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:38:50.877834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'97","reported_seq":2165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.545937+0000","last_change":"2024-04-26T18:03:24.635610+0000","last_active":"2024-04-26T18:08:28.545937+0000","last_peered":"2024-04-26T18:08:28.545937+0000","last_clean":"2024-04-26T18:08:28.545937+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:08:28.545937+0000","last_undegraded":"2024-04-26T18:08:28.545937+0000","last_fullsized":"2024-04-26T18:08:28.545937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:49:01.517984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"36'85","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.541585+0000","last_change":"2024-04-26T18:03:24.746082+0000","last_active":"2024-04-26T18:08:28.541585+0000","last_peered":"2024-04-26T18:08:28.541585+0000","last_clean":"2024-04-26T18:08:28.541585+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:08:28.541585+0000","last_undegraded":"2024-04-26T18:08:28.541585+0000","last_fullsized":"2024-04-26T18:08:28.541585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:46:01.306469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'92","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.550598+0000","last_change":"2024-04-26T18:03:25.011535+0000","last_active":"2024-04-26T18:08:28.550598+0000","last_peered":"2024-04-26T18:08:28.550598+0000","last_clean":"2024-04-26T18:08:28.550598+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:08:28.550598+0000","last_undegraded":"2024-04-26T18:08:28.550598+0000","last_fullsized":"2024-04-26T18:08:28.550598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:59.943859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"36'81","reported_seq":2150,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.564033+0000","last_change":"2024-04-26T18:03:24.968688+0000","last_active":"2024-04-26T18:08:28.564033+0000","last_peered":"2024-04-26T18:08:28.564033+0000","last_clean":"2024-04-26T18:08:28.564033+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:08:28.564033+0000","last_undegraded":"2024-04-26T18:08:28.564033+0000","last_fullsized":"2024-04-26T18:08:28.564033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:32:44.526595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'76","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.562041+0000","last_change":"2024-04-26T18:03:24.656824+0000","last_active":"2024-04-26T18:08:28.562041+0000","last_peered":"2024-04-26T18:08:28.562041+0000","last_clean":"2024-04-26T18:08:28.562041+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:08:28.562041+0000","last_undegraded":"2024-04-26T18:08:28.562041+0000","last_fullsized":"2024-04-26T18:08:28.562041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:23:16.985387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'91","reported_seq":2160,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.545148+0000","last_change":"2024-04-26T18:03:24.634849+0000","last_active":"2024-04-26T18:08:28.545148+0000","last_peered":"2024-04-26T18:08:28.545148+0000","last_clean":"2024-04-26T18:08:28.545148+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:08:28.545148+0000","last_undegraded":"2024-04-26T18:08:28.545148+0000","last_fullsized":"2024-04-26T18:08:28.545148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:42:24.994234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'99","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.563139+0000","last_change":"2024-04-26T18:03:24.636282+0000","last_active":"2024-04-26T18:08:28.563139+0000","last_peered":"2024-04-26T18:08:28.563139+0000","last_clean":"2024-04-26T18:08:28.563139+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:08:28.563139+0000","last_undegraded":"2024-04-26T18:08:28.563139+0000","last_fullsized":"2024-04-26T18:08:28.563139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:55:07.014169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'84","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.561415+0000","last_change":"2024-04-26T18:03:24.946554+0000","last_active":"2024-04-26T18:08:28.561415+0000","last_peered":"2024-04-26T18:08:28.561415+0000","last_clean":"2024-04-26T18:08:28.561415+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:08:28.561415+0000","last_undegraded":"2024-04-26T18:08:28.561415+0000","last_fullsized":"2024-04-26T18:08:28.561415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:44.578641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"36'74","reported_seq":2143,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.563330+0000","last_change":"2024-04-26T18:03:24.995186+0000","last_active":"2024-04-26T18:08:28.563330+0000","last_peered":"2024-04-26T18:08:28.563330+0000","last_clean":"2024-04-26T18:08:28.563330+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:08:28.563330+0000","last_undegraded":"2024-04-26T18:08:28.563330+0000","last_fullsized":"2024-04-26T18:08:28.563330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:01:02.213721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'104","reported_seq":2173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.556201+0000","last_change":"2024-04-26T18:03:24.942130+0000","last_active":"2024-04-26T18:08:28.556201+0000","last_peered":"2024-04-26T18:08:28.556201+0000","last_clean":"2024-04-26T18:08:28.556201+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:08:28.556201+0000","last_undegraded":"2024-04-26T18:08:28.556201+0000","last_fullsized":"2024-04-26T18:08:28.556201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:04:58.029188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"36'92","reported_seq":2146,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.551202+0000","last_change":"2024-04-26T18:03:24.852029+0000","last_active":"2024-04-26T18:08:28.551202+0000","last_peered":"2024-04-26T18:08:28.551202+0000","last_clean":"2024-04-26T18:08:28.551202+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:08:28.551202+0000","last_undegraded":"2024-04-26T18:08:28.551202+0000","last_fullsized":"2024-04-26T18:08:28.551202+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:15:23.464299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"36'102","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.553834+0000","last_change":"2024-04-26T18:03:24.932964+0000","last_active":"2024-04-26T18:08:28.553834+0000","last_peered":"2024-04-26T18:08:28.553834+0000","last_clean":"2024-04-26T18:08:28.553834+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:08:28.553834+0000","last_undegraded":"2024-04-26T18:08:28.553834+0000","last_fullsized":"2024-04-26T18:08:28.553834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:24.157039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'76","reported_seq":2145,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.560756+0000","last_change":"2024-04-26T18:03:24.641802+0000","last_active":"2024-04-26T18:08:28.560756+0000","last_peered":"2024-04-26T18:08:28.560756+0000","last_clean":"2024-04-26T18:08:28.560756+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:08:28.560756+0000","last_undegraded":"2024-04-26T18:08:28.560756+0000","last_fullsized":"2024-04-26T18:08:28.560756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:18:40.921369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"36'90","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.555767+0000","last_change":"2024-04-26T18:03:25.004919+0000","last_active":"2024-04-26T18:08:28.555767+0000","last_peered":"2024-04-26T18:08:28.555767+0000","last_clean":"2024-04-26T18:08:28.555767+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:08:28.555767+0000","last_undegraded":"2024-04-26T18:08:28.555767+0000","last_fullsized":"2024-04-26T18:08:28.555767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:19:52.306796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'75","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.546740+0000","last_change":"2024-04-26T18:03:24.745389+0000","last_active":"2024-04-26T18:08:28.546740+0000","last_peered":"2024-04-26T18:08:28.546740+0000","last_clean":"2024-04-26T18:08:28.546740+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:08:28.546740+0000","last_undegraded":"2024-04-26T18:08:28.546740+0000","last_fullsized":"2024-04-26T18:08:28.546740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:10:12.173305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"36'86","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:28.563930+0000","last_change":"2024-04-26T18:03:24.945776+0000","last_active":"2024-04-26T18:08:28.563930+0000","last_peered":"2024-04-26T18:08:28.563930+0000","last_clean":"2024-04-26T18:08:28.563930+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:08:28.563930+0000","last_undegraded":"2024-04-26T18:08:28.563930+0000","last_fullsized":"2024-04-26T18:08:28.563930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:13.836260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5776,"ondisk_log_size":5776,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":237757755,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8680,"num_write_kb":241026,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":475578368,"data_stored":475515510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8319,"ondisk_log_size":8319,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574977,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374264,"kb_used_data":288944,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93997576,"statfs":{"total":96636764160,"available":96253517824,"internally_reserved":0,"allocated":295878656,"data_stored":295659565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":449444,"kb_used_data":337820,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93922396,"statfs":{"total":96636764160,"available":96176533504,"internally_reserved":0,"allocated":345927680,"data_stored":345704962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574978,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345068,"kb_used_data":263908,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94026772,"statfs":{"total":96636764160,"available":96283414528,"internally_reserved":0,"allocated":270241792,"data_stored":270025761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":416500,"kb_used_data":317292,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93955340,"statfs":{"total":96636764160,"available":96210268160,"internally_reserved":0,"allocated":324907008,"data_stored":324679648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574978,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527448,"kb_used_data":397712,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":93844392,"statfs":{"total":96636764160,"available":96096657408,"internally_reserved":0,"allocated":407257088,"data_stored":407036489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132839879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574979,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274140,"kb_used_data":198548,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94097700,"statfs":{"total":96636764160,"available":96356044800,"internally_reserved":0,"allocated":203313152,"data_stored":203100073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":490184,"kb_used_data":378496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93881656,"statfs":{"total":96636764160,"available":96134815744,"internally_reserved":0,"allocated":387579904,"data_stored":387359847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574978,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353376,"kb_used_data":259736,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94018464,"statfs":{"total":96636764160,"available":96274907136,"internally_reserved":0,"allocated":265969664,"data_stored":265742437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67117056,"data_stored":67109024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50917376,"data_stored":50908802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65228800,"data_stored":65213465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67108954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73613312,"data_stored":73602619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:08:35.639 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.640 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.641 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.642 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.643 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.644 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.646 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T17:58:02.006207+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=2, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.647 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.648 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.649 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.650 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.651 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.652 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.653 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.654 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-26T17:58:11.463644+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=11, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.655 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.656 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.657 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.658 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.659 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.660 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.660 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.660 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:35.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T18:08:45.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:45.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:08:55.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:08:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.776+0000 7fbde8397640 1 Processor -- start 2024-04-26T18:08:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.776+0000 7fbde8397640 1 -- start start 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.776+0000 7fbde8397640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbde00ca140 0x7fbde0155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde8397640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde8397640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde015bc90 con 0x7fbde0070150 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde8397640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fbde015bf70 con 0x7fbde00ca140 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde8397640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbde015c250 con 0x7fbde00ca520 2024-04-26T18:08:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbde00ca140 0x7fbde0155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde5932640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde5932640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:36060/0 (socket says 172.21.15.12:36060) 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde5932640 1 -- 172.21.15.12:0/1919506415 learned_addr learned my addr 172.21.15.12:0/1919506415 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fbde00ca140 0x7fbde0155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:54424/0 (socket says 172.21.15.12:54424) 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 -- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 msgr2=0x7fbde0155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 -- 172.21.15.12:0/1919506415 >> v1:172.21.15.100:6789/0 conn(0x7fbde0070150 legacy=0x7fbde00cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde5131640 1 -- 172.21.15.12:0/1919506415 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564355636 0 0) 0x7fbde015bc90 con 0x7fbde0070150 2024-04-26T18:08:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde6133640 1 -- 172.21.15.12:0/1919506415 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde015c530 con 0x7fbde00ca140 2024-04-26T18:08:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.777+0000 7fbde5932640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:08:55.780 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.778+0000 7fbde6133640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca140 0x7fbde0155920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00097a0 tx=0x7fbdd002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3a9bcfdaaf3a08 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.778+0000 7fbde5131640 1 -- 172.21.15.12:0/1919506415 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0037070 con 0x7fbde00ca140 2024-04-26T18:08:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.778+0000 7fbde5131640 1 -- 172.21.15.12:0/1919506415 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd0032440 con 0x7fbde00ca140 2024-04-26T18:08:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.778+0000 7fbde5131640 1 -- 172.21.15.12:0/1919506415 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0032810 con 0x7fbde00ca140 2024-04-26T18:08:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 -- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca140 msgr2=0x7fbde0155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca140 0x7fbde0155920 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdd00097a0 tx=0x7fbdd002a180 comp rx=0 tx=0).stop 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 -- 172.21.15.12:0/1919506415 shutdown_connections 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde00ca520 0x7fbde0155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 --2- 172.21.15.12:0/1919506415 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca140 0x7fbde0155920 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 -- 172.21.15.12:0/1919506415 >> 172.21.15.12:0/1919506415 conn(0x7fbde0071ec0 msgr2=0x7fbde00722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 -- 172.21.15.12:0/1919506415 shutdown_connections 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.779+0000 7fbde8397640 1 -- 172.21.15.12:0/1919506415 wait complete. 2024-04-26T18:08:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.780+0000 7fbde8397640 1 Processor -- start 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.780+0000 7fbde8397640 1 -- start start 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde0070150 0x7fbde00c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca520 0x7fbde00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00cc670 con 0x7fbde00ca140 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fbde00716a0 con 0x7fbde00ca520 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde8397640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fbde00cc7f0 con 0x7fbde0070150 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:59774/0 (socket says 172.21.15.12:59774) 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 -- 172.21.15.12:0/1776888805 learned_addr learned my addr 172.21.15.12:0/1776888805 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde6934640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca520 0x7fbde00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde6133640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde0070150 0x7fbde00c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 -- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde0070150 msgr2=0x7fbde00c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde0070150 0x7fbde00c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 -- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca520 msgr2=0x7fbde00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca520 0x7fbde00c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.781+0000 7fbde5932640 1 -- 172.21.15.12:0/1776888805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde00c6b50 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbde5932640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e9e0 tx=0x7fbdd400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4017070 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdd400c970 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd400cd20 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde00c9370 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.782+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde01f2390 con 0x7fbde00ca140 2024-04-26T18:08:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.783+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde0076d20 con 0x7fbde00ca140 2024-04-26T18:08:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.783+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdd401a070 con 0x7fbde00ca140 2024-04-26T18:08:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.784+0000 7fbddeffd640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 0x7fbdcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:08:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.784+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fbdd408bda0 con 0x7fbde00ca140 2024-04-26T18:08:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.784+0000 7fbde6133640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 0x7fbdcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:08:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.785+0000 7fbde6133640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 0x7fbdcc06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034000 tx=0x7fbdd002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:08:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.788+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbdd4059740 con 0x7fbde00ca140 2024-04-26T18:08:55.972 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.972+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbde0071480 con 0x7fbdcc06c8f0 2024-04-26T18:08:55.981 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.981+0000 7fbddeffd640 1 -- 172.21.15.12:0/1776888805 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337221 (secure 0 0 0) 0x7fbde0071480 con 0x7fbdcc06c8f0 2024-04-26T18:08:55.987 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:08:55.989 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 msgr2=0x7fbdcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 0x7fbdcc06edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0034000 tx=0x7fbdd002e000 comp rx=0 tx=0).stop 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 msgr2=0x7fbde0154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e9e0 tx=0x7fbdd400eea0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 shutdown_connections 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbde00ca520 0x7fbde00c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.991 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbde00ca140 0x7fbde0154730 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fbdcc06c8f0 0x7fbdcc06edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.984+0000 7fbde8397640 1 --2- 172.21.15.12:0/1776888805 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbde0070150 0x7fbde00c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:08:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.985+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 >> 172.21.15.12:0/1776888805 conn(0x7fbde0071ec0 msgr2=0x7fbde0156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:08:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.985+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 shutdown_connections 2024-04-26T18:08:55.992 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:08:55.985+0000 7fbde8397640 1 -- 172.21.15.12:0/1776888805 wait complete. 2024-04-26T18:08:55.995 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-04-26T18:08:54.040970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188747990,"num_objects":10790,"num_object_clones":0,"num_object_copies":42852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10790,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30422,"num_write_kb":1788338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":665880,"num_omap_keys":1113,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35933,"ondisk_log_size":35933,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3231696,"kb_used_data":2443728,"kb_used_omap":12,"kb_used_meta":787891,"kb_avail":751743024,"statfs":{"total":773094113280,"available":769784856576,"internally_reserved":0,"allocated":2502377472,"data_stored":2500614068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":806800944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":190216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19056,"num_omap_keys":32,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003300"},"pg_stats":[{"pgid":"2.1f","version":"36'132","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.389841+0000","last_change":"2024-04-26T18:08:34.389841+0000","last_active":"2024-04-26T18:08:34.389841+0000","last_peered":"2024-04-26T18:08:34.389841+0000","last_clean":"2024-04-26T18:08:34.389841+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:08:34.389841+0000","last_undegraded":"2024-04-26T18:08:34.389841+0000","last_fullsized":"2024-04-26T18:08:34.389841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'132","last_scrub_stamp":"2024-04-26T18:08:34.389684+0000","last_deep_scrub":"36'132","last_deep_scrub_stamp":"2024-04-26T18:08:34.389684+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.389684+0000","objects_scrubbed":10,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:21.946000+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":70339,"num_omap_keys":117,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'92","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.530201+0000","last_change":"2024-04-26T18:08:43.530228+0000","last_active":"2024-04-26T18:08:43.530201+0000","last_peered":"2024-04-26T18:08:43.530201+0000","last_clean":"2024-04-26T18:08:43.530201+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:08:43.530201+0000","last_undegraded":"2024-04-26T18:08:43.530201+0000","last_fullsized":"2024-04-26T18:08:43.530201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:43.530114+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:43.530114+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.530114+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:49.267100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:51.632835+0000","last_change":"2024-04-26T18:08:51.632873+0000","last_active":"2024-04-26T18:08:51.632835+0000","last_peered":"2024-04-26T18:08:51.632835+0000","last_clean":"2024-04-26T18:08:51.632835+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:51.632835+0000","last_undegraded":"2024-04-26T18:08:51.632835+0000","last_fullsized":"2024-04-26T18:08:51.632835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'687","last_scrub_stamp":"2024-04-26T18:08:51.632751+0000","last_deep_scrub":"36'687","last_deep_scrub_stamp":"2024-04-26T18:08:51.632751+0000","last_clean_scrub_stamp":"2024-04-26T18:08:51.632751+0000","objects_scrubbed":319,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:03.654507+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1627","reported_seq":1687,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.521408+0000","last_change":"2024-04-26T18:08:40.521442+0000","last_active":"2024-04-26T18:08:40.521408+0000","last_peered":"2024-04-26T18:08:40.521408+0000","last_clean":"2024-04-26T18:08:40.521408+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:40.521408+0000","last_undegraded":"2024-04-26T18:08:40.521408+0000","last_fullsized":"2024-04-26T18:08:40.521408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1627","last_scrub_stamp":"2024-04-26T18:08:40.521335+0000","last_deep_scrub":"36'1627","last_deep_scrub_stamp":"2024-04-26T18:08:40.521335+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.521335+0000","objects_scrubbed":5,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:37.360676+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21245,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'87","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.352891+0000","last_change":"2024-04-26T18:08:40.352891+0000","last_active":"2024-04-26T18:08:40.352891+0000","last_peered":"2024-04-26T18:08:40.352891+0000","last_clean":"2024-04-26T18:08:40.352891+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:08:40.352891+0000","last_undegraded":"2024-04-26T18:08:40.352891+0000","last_fullsized":"2024-04-26T18:08:40.352891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-04-26T18:08:40.352791+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-04-26T18:08:40.352791+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.352791+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:04.244222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2812,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.224190+0000","last_change":"2024-04-26T18:08:44.224221+0000","last_active":"2024-04-26T18:08:44.224190+0000","last_peered":"2024-04-26T18:08:44.224190+0000","last_clean":"2024-04-26T18:08:44.224190+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:44.224190+0000","last_undegraded":"2024-04-26T18:08:44.224190+0000","last_fullsized":"2024-04-26T18:08:44.224190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'690","last_scrub_stamp":"2024-04-26T18:08:44.224102+0000","last_deep_scrub":"36'690","last_deep_scrub_stamp":"2024-04-26T18:08:44.224102+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.224102+0000","objects_scrubbed":353,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:35.555154+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'727","reported_seq":786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.538218+0000","last_change":"2024-04-26T18:08:40.538254+0000","last_active":"2024-04-26T18:08:40.538218+0000","last_peered":"2024-04-26T18:08:40.538218+0000","last_clean":"2024-04-26T18:08:40.538218+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:40.538218+0000","last_undegraded":"2024-04-26T18:08:40.538218+0000","last_fullsized":"2024-04-26T18:08:40.538218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'727","last_scrub_stamp":"2024-04-26T18:08:40.538152+0000","last_deep_scrub":"36'727","last_deep_scrub_stamp":"2024-04-26T18:08:40.538152+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.538152+0000","objects_scrubbed":7,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:01.782633+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20619,"num_omap_keys":35,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'91","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.369207+0000","last_change":"2024-04-26T18:08:44.369227+0000","last_active":"2024-04-26T18:08:44.369207+0000","last_peered":"2024-04-26T18:08:44.369207+0000","last_clean":"2024-04-26T18:08:44.369207+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:08:44.369207+0000","last_undegraded":"2024-04-26T18:08:44.369207+0000","last_fullsized":"2024-04-26T18:08:44.369207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:44.369125+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:44.369125+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.369125+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:26.703934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.231767+0000","last_change":"2024-04-26T18:08:43.231802+0000","last_active":"2024-04-26T18:08:43.231767+0000","last_peered":"2024-04-26T18:08:43.231767+0000","last_clean":"2024-04-26T18:08:43.231767+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:43.231767+0000","last_undegraded":"2024-04-26T18:08:43.231767+0000","last_fullsized":"2024-04-26T18:08:43.231767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'688","last_scrub_stamp":"2024-04-26T18:08:43.231685+0000","last_deep_scrub":"36'688","last_deep_scrub_stamp":"2024-04-26T18:08:43.231685+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.231685+0000","objects_scrubbed":316,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:11.124607+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'168","reported_seq":227,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.484492+0000","last_change":"2024-04-26T18:08:39.484546+0000","last_active":"2024-04-26T18:08:39.484492+0000","last_peered":"2024-04-26T18:08:39.484492+0000","last_clean":"2024-04-26T18:08:39.484492+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:39.484492+0000","last_undegraded":"2024-04-26T18:08:39.484492+0000","last_fullsized":"2024-04-26T18:08:39.484492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'168","last_scrub_stamp":"2024-04-26T18:08:39.484398+0000","last_deep_scrub":"36'168","last_deep_scrub_stamp":"2024-04-26T18:08:39.484398+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.484398+0000","objects_scrubbed":5,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:03.756852+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29136,"num_omap_keys":48,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'90","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.388855+0000","last_change":"2024-04-26T18:08:45.388875+0000","last_active":"2024-04-26T18:08:45.388855+0000","last_peered":"2024-04-26T18:08:45.388855+0000","last_clean":"2024-04-26T18:08:45.388855+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:08:45.388855+0000","last_undegraded":"2024-04-26T18:08:45.388855+0000","last_fullsized":"2024-04-26T18:08:45.388855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:45.388786+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:45.388786+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.388786+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:44.265542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.231511+0000","last_change":"2024-04-26T18:08:45.231564+0000","last_active":"2024-04-26T18:08:45.231511+0000","last_peered":"2024-04-26T18:08:45.231511+0000","last_clean":"2024-04-26T18:08:45.231511+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:45.231511+0000","last_undegraded":"2024-04-26T18:08:45.231511+0000","last_fullsized":"2024-04-26T18:08:45.231511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'676","last_scrub_stamp":"2024-04-26T18:08:45.231396+0000","last_deep_scrub":"36'676","last_deep_scrub_stamp":"2024-04-26T18:08:45.231396+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.231396+0000","objects_scrubbed":338,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:06.309548+0000","scrub_duration":136,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.216691+0000","last_change":"2024-04-26T18:08:42.216711+0000","last_active":"2024-04-26T18:08:42.216691+0000","last_peered":"2024-04-26T18:08:42.216691+0000","last_clean":"2024-04-26T18:08:42.216691+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:08:42.216691+0000","last_undegraded":"2024-04-26T18:08:42.216691+0000","last_fullsized":"2024-04-26T18:08:42.216691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:42.216625+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:42.216625+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.216625+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:57.648719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'231","reported_seq":290,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.497853+0000","last_change":"2024-04-26T18:08:38.497893+0000","last_active":"2024-04-26T18:08:38.497853+0000","last_peered":"2024-04-26T18:08:38.497853+0000","last_clean":"2024-04-26T18:08:38.497853+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:08:38.497853+0000","last_undegraded":"2024-04-26T18:08:38.497853+0000","last_fullsized":"2024-04-26T18:08:38.497853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'231","last_scrub_stamp":"2024-04-26T18:08:38.497760+0000","last_deep_scrub":"36'231","last_deep_scrub_stamp":"2024-04-26T18:08:38.497760+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.497760+0000","objects_scrubbed":6,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:55.918548+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24887,"num_omap_keys":41,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2776,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.218533+0000","last_change":"2024-04-26T18:08:46.218577+0000","last_active":"2024-04-26T18:08:46.218533+0000","last_peered":"2024-04-26T18:08:46.218533+0000","last_clean":"2024-04-26T18:08:46.218533+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:46.218533+0000","last_undegraded":"2024-04-26T18:08:46.218533+0000","last_fullsized":"2024-04-26T18:08:46.218533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'653","last_scrub_stamp":"2024-04-26T18:08:46.218439+0000","last_deep_scrub":"36'653","last_deep_scrub_stamp":"2024-04-26T18:08:46.218439+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.218439+0000","objects_scrubbed":314,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:41.353180+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.503504+0000","last_change":"2024-04-26T18:08:42.503528+0000","last_active":"2024-04-26T18:08:42.503504+0000","last_peered":"2024-04-26T18:08:42.503504+0000","last_clean":"2024-04-26T18:08:42.503504+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:08:42.503504+0000","last_undegraded":"2024-04-26T18:08:42.503504+0000","last_fullsized":"2024-04-26T18:08:42.503504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:42.503421+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:42.503421+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.503421+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.788240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'842","reported_seq":901,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.953218+0000","last_change":"2024-04-26T18:08:38.953253+0000","last_active":"2024-04-26T18:08:38.953218+0000","last_peered":"2024-04-26T18:08:38.953218+0000","last_clean":"2024-04-26T18:08:38.953218+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:08:38.953218+0000","last_undegraded":"2024-04-26T18:08:38.953218+0000","last_fullsized":"2024-04-26T18:08:38.953218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'842","last_scrub_stamp":"2024-04-26T18:08:38.953137+0000","last_deep_scrub":"36'842","last_deep_scrub_stamp":"2024-04-26T18:08:38.953137+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.953137+0000","objects_scrubbed":5,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.105328+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17603,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2815,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.191237+0000","last_change":"2024-04-26T18:08:41.191289+0000","last_active":"2024-04-26T18:08:41.191237+0000","last_peered":"2024-04-26T18:08:41.191237+0000","last_clean":"2024-04-26T18:08:41.191237+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:41.191237+0000","last_undegraded":"2024-04-26T18:08:41.191237+0000","last_fullsized":"2024-04-26T18:08:41.191237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'695","last_scrub_stamp":"2024-04-26T18:08:41.191145+0000","last_deep_scrub":"36'695","last_deep_scrub_stamp":"2024-04-26T18:08:41.191145+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.191145+0000","objects_scrubbed":328,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:00.278381+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'94","reported_seq":2172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.494776+0000","last_change":"2024-04-26T18:08:35.494798+0000","last_active":"2024-04-26T18:08:35.494776+0000","last_peered":"2024-04-26T18:08:35.494776+0000","last_clean":"2024-04-26T18:08:35.494776+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:08:35.494776+0000","last_undegraded":"2024-04-26T18:08:35.494776+0000","last_fullsized":"2024-04-26T18:08:35.494776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'94","last_scrub_stamp":"2024-04-26T18:08:35.494706+0000","last_deep_scrub":"36'94","last_deep_scrub_stamp":"2024-04-26T18:08:35.494706+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.494706+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.112600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'73","reported_seq":132,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.893092+0000","last_change":"2024-04-26T18:08:37.893127+0000","last_active":"2024-04-26T18:08:37.893092+0000","last_peered":"2024-04-26T18:08:37.893092+0000","last_clean":"2024-04-26T18:08:37.893092+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:37.893092+0000","last_undegraded":"2024-04-26T18:08:37.893092+0000","last_fullsized":"2024-04-26T18:08:37.893092+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-04-26T18:08:37.893011+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-04-26T18:08:37.893011+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.893011+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:34.704512+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50246,"num_omap_keys":84,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2816,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.169263+0000","last_change":"2024-04-26T18:08:49.169314+0000","last_active":"2024-04-26T18:08:49.169263+0000","last_peered":"2024-04-26T18:08:49.169263+0000","last_clean":"2024-04-26T18:08:49.169263+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:49.169263+0000","last_undegraded":"2024-04-26T18:08:49.169263+0000","last_fullsized":"2024-04-26T18:08:49.169263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'688","last_scrub_stamp":"2024-04-26T18:08:49.169183+0000","last_deep_scrub":"36'688","last_deep_scrub_stamp":"2024-04-26T18:08:49.169183+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.169183+0000","objects_scrubbed":349,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:13.808961+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'93","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.050669+0000","last_change":"2024-04-26T18:08:36.050694+0000","last_active":"2024-04-26T18:08:36.050669+0000","last_peered":"2024-04-26T18:08:36.050669+0000","last_clean":"2024-04-26T18:08:36.050669+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:08:36.050669+0000","last_undegraded":"2024-04-26T18:08:36.050669+0000","last_fullsized":"2024-04-26T18:08:36.050669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:36.050537+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:36.050537+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.050537+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:35.363772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'9","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.564641+0000","last_change":"2024-04-26T18:08:42.564667+0000","last_active":"2024-04-26T18:08:42.564641+0000","last_peered":"2024-04-26T18:08:42.564641+0000","last_clean":"2024-04-26T18:08:42.564641+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:08:42.564641+0000","last_undegraded":"2024-04-26T18:08:42.564641+0000","last_fullsized":"2024-04-26T18:08:42.564641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-04-26T18:08:42.564578+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-04-26T18:08:42.564578+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.564578+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:31.462490+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19056,"num_omap_keys":32,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2719,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.146398+0000","last_change":"2024-04-26T18:08:40.146460+0000","last_active":"2024-04-26T18:08:40.146398+0000","last_peered":"2024-04-26T18:08:40.146398+0000","last_clean":"2024-04-26T18:08:40.146398+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:40.146398+0000","last_undegraded":"2024-04-26T18:08:40.146398+0000","last_fullsized":"2024-04-26T18:08:40.146398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'594","last_scrub_stamp":"2024-04-26T18:08:40.146285+0000","last_deep_scrub":"36'594","last_deep_scrub_stamp":"2024-04-26T18:08:40.146285+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.146285+0000","objects_scrubbed":311,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:53.835655+0000","scrub_duration":109,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"36'93","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.343751+0000","last_change":"2024-04-26T18:08:42.343792+0000","last_active":"2024-04-26T18:08:42.343751+0000","last_peered":"2024-04-26T18:08:42.343751+0000","last_clean":"2024-04-26T18:08:42.343751+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:08:42.343751+0000","last_undegraded":"2024-04-26T18:08:42.343751+0000","last_fullsized":"2024-04-26T18:08:42.343751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:42.343662+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:42.343662+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.343662+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:47.971249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'194","reported_seq":253,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.079713+0000","last_change":"2024-04-26T18:08:36.079750+0000","last_active":"2024-04-26T18:08:36.079713+0000","last_peered":"2024-04-26T18:08:36.079713+0000","last_clean":"2024-04-26T18:08:36.079713+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:08:36.079713+0000","last_undegraded":"2024-04-26T18:08:36.079713+0000","last_fullsized":"2024-04-26T18:08:36.079713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'194","last_scrub_stamp":"2024-04-26T18:08:36.079615+0000","last_deep_scrub":"36'194","last_deep_scrub_stamp":"2024-04-26T18:08:36.079615+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.079615+0000","objects_scrubbed":2,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:16.335076+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2822,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.264587+0000","last_change":"2024-04-26T18:08:47.264666+0000","last_active":"2024-04-26T18:08:47.264587+0000","last_peered":"2024-04-26T18:08:47.264587+0000","last_clean":"2024-04-26T18:08:47.264587+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:47.264587+0000","last_undegraded":"2024-04-26T18:08:47.264587+0000","last_fullsized":"2024-04-26T18:08:47.264587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'707","last_scrub_stamp":"2024-04-26T18:08:47.264498+0000","last_deep_scrub":"36'707","last_deep_scrub_stamp":"2024-04-26T18:08:47.264498+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.264498+0000","objects_scrubbed":346,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:51.300682+0000","scrub_duration":138,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'88","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.084509+0000","last_change":"2024-04-26T18:08:50.084534+0000","last_active":"2024-04-26T18:08:50.084509+0000","last_peered":"2024-04-26T18:08:50.084509+0000","last_clean":"2024-04-26T18:08:50.084509+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:08:50.084509+0000","last_undegraded":"2024-04-26T18:08:50.084509+0000","last_fullsized":"2024-04-26T18:08:50.084509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:50.084440+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:50.084440+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.084440+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:00.429009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'262","reported_seq":321,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.876680+0000","last_change":"2024-04-26T18:08:36.876721+0000","last_active":"2024-04-26T18:08:36.876680+0000","last_peered":"2024-04-26T18:08:36.876680+0000","last_clean":"2024-04-26T18:08:36.876680+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:36.876680+0000","last_undegraded":"2024-04-26T18:08:36.876680+0000","last_fullsized":"2024-04-26T18:08:36.876680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'262","last_scrub_stamp":"2024-04-26T18:08:36.876608+0000","last_deep_scrub":"36'262","last_deep_scrub_stamp":"2024-04-26T18:08:36.876608+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.876608+0000","objects_scrubbed":3,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:14.110826+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9666,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2830,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.690131+0000","last_change":"2024-04-26T18:03:24.996787+0000","last_active":"2024-04-26T18:08:26.690131+0000","last_peered":"2024-04-26T18:08:26.690131+0000","last_clean":"2024-04-26T18:08:26.690131+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:26.690131+0000","last_undegraded":"2024-04-26T18:08:26.690131+0000","last_fullsized":"2024-04-26T18:08:26.690131+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.894969+0000","last_change":"2024-04-26T18:08:41.894969+0000","last_active":"2024-04-26T18:08:41.894969+0000","last_peered":"2024-04-26T18:08:41.894969+0000","last_clean":"2024-04-26T18:08:41.894969+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:08:41.894969+0000","last_undegraded":"2024-04-26T18:08:41.894969+0000","last_fullsized":"2024-04-26T18:08:41.894969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:41.894850+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:41.894850+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.894850+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.849930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'147","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.560326+0000","last_change":"2024-04-26T18:08:41.560372+0000","last_active":"2024-04-26T18:08:41.560326+0000","last_peered":"2024-04-26T18:08:41.560326+0000","last_clean":"2024-04-26T18:08:41.560326+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:08:41.560326+0000","last_undegraded":"2024-04-26T18:08:41.560326+0000","last_fullsized":"2024-04-26T18:08:41.560326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'147","last_scrub_stamp":"2024-04-26T18:08:41.560237+0000","last_deep_scrub":"36'147","last_deep_scrub_stamp":"2024-04-26T18:08:41.560237+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.560237+0000","objects_scrubbed":3,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:52.907427+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2808,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.547050+0000","last_change":"2024-04-26T18:08:46.547086+0000","last_active":"2024-04-26T18:08:46.547050+0000","last_peered":"2024-04-26T18:08:46.547050+0000","last_clean":"2024-04-26T18:08:46.547050+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:46.547050+0000","last_undegraded":"2024-04-26T18:08:46.547050+0000","last_fullsized":"2024-04-26T18:08:46.547050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'686","last_scrub_stamp":"2024-04-26T18:08:46.546969+0000","last_deep_scrub":"36'686","last_deep_scrub_stamp":"2024-04-26T18:08:46.546969+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.546969+0000","objects_scrubbed":320,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:55.026094+0000","scrub_duration":104,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'84","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.375411+0000","last_change":"2024-04-26T18:08:42.375433+0000","last_active":"2024-04-26T18:08:42.375411+0000","last_peered":"2024-04-26T18:08:42.375411+0000","last_clean":"2024-04-26T18:08:42.375411+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:08:42.375411+0000","last_undegraded":"2024-04-26T18:08:42.375411+0000","last_fullsized":"2024-04-26T18:08:42.375411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-04-26T18:08:42.375344+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-04-26T18:08:42.375344+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.375344+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:34.776468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'134","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.871325+0000","last_change":"2024-04-26T18:08:35.871325+0000","last_active":"2024-04-26T18:08:35.871325+0000","last_peered":"2024-04-26T18:08:35.871325+0000","last_clean":"2024-04-26T18:08:35.871325+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:35.871325+0000","last_undegraded":"2024-04-26T18:08:35.871325+0000","last_fullsized":"2024-04-26T18:08:35.871325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'134","last_scrub_stamp":"2024-04-26T18:08:35.871188+0000","last_deep_scrub":"36'134","last_deep_scrub_stamp":"2024-04-26T18:08:35.871188+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.871188+0000","objects_scrubbed":5,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:21.498324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20316,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.111216+0000","last_change":"2024-04-26T18:08:46.111266+0000","last_active":"2024-04-26T18:08:46.111216+0000","last_peered":"2024-04-26T18:08:46.111216+0000","last_clean":"2024-04-26T18:08:46.111216+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:46.111216+0000","last_undegraded":"2024-04-26T18:08:46.111216+0000","last_fullsized":"2024-04-26T18:08:46.111216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'699","last_scrub_stamp":"2024-04-26T18:08:46.111099+0000","last_deep_scrub":"36'699","last_deep_scrub_stamp":"2024-04-26T18:08:46.111099+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.111099+0000","objects_scrubbed":331,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:34.225964+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'96","reported_seq":2175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.075281+0000","last_change":"2024-04-26T18:08:35.075281+0000","last_active":"2024-04-26T18:08:35.075281+0000","last_peered":"2024-04-26T18:08:35.075281+0000","last_clean":"2024-04-26T18:08:35.075281+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:08:35.075281+0000","last_undegraded":"2024-04-26T18:08:35.075281+0000","last_fullsized":"2024-04-26T18:08:35.075281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-04-26T18:08:35.075168+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-04-26T18:08:35.075168+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.075168+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:33.449863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'13","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.300201+0000","last_change":"2024-04-26T18:08:39.300257+0000","last_active":"2024-04-26T18:08:39.300201+0000","last_peered":"2024-04-26T18:08:39.300201+0000","last_clean":"2024-04-26T18:08:39.300201+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:08:39.300201+0000","last_undegraded":"2024-04-26T18:08:39.300201+0000","last_fullsized":"2024-04-26T18:08:39.300201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-04-26T18:08:39.300102+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-04-26T18:08:39.300102+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.300102+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:25.062601+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19912,"num_omap_keys":34,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.066978+0000","last_change":"2024-04-26T18:08:45.067007+0000","last_active":"2024-04-26T18:08:45.066978+0000","last_peered":"2024-04-26T18:08:45.066978+0000","last_clean":"2024-04-26T18:08:45.066978+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:45.066978+0000","last_undegraded":"2024-04-26T18:08:45.066978+0000","last_fullsized":"2024-04-26T18:08:45.066978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'645","last_scrub_stamp":"2024-04-26T18:08:45.066893+0000","last_deep_scrub":"36'645","last_deep_scrub_stamp":"2024-04-26T18:08:45.066893+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.066893+0000","objects_scrubbed":329,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:56.222363+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"36'83","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.928529+0000","last_change":"2024-04-26T18:08:40.928567+0000","last_active":"2024-04-26T18:08:40.928529+0000","last_peered":"2024-04-26T18:08:40.928529+0000","last_clean":"2024-04-26T18:08:40.928529+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:08:40.928529+0000","last_undegraded":"2024-04-26T18:08:40.928529+0000","last_fullsized":"2024-04-26T18:08:40.928529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:40.928427+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:40.928427+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.928427+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:17.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'128","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.541649+0000","last_change":"2024-04-26T18:08:33.541649+0000","last_active":"2024-04-26T18:08:33.541649+0000","last_peered":"2024-04-26T18:08:33.541649+0000","last_clean":"2024-04-26T18:08:33.541649+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:08:33.541649+0000","last_undegraded":"2024-04-26T18:08:33.541649+0000","last_fullsized":"2024-04-26T18:08:33.541649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'128","last_scrub_stamp":"2024-04-26T18:08:33.541495+0000","last_deep_scrub":"36'128","last_deep_scrub_stamp":"2024-04-26T18:08:33.541495+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.541495+0000","objects_scrubbed":4,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:20.308421+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30865,"num_omap_keys":51,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2765,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.145087+0000","last_change":"2024-04-26T18:08:47.145142+0000","last_active":"2024-04-26T18:08:47.145087+0000","last_peered":"2024-04-26T18:08:47.145087+0000","last_clean":"2024-04-26T18:08:47.145087+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:47.145087+0000","last_undegraded":"2024-04-26T18:08:47.145087+0000","last_fullsized":"2024-04-26T18:08:47.145087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'644","last_scrub_stamp":"2024-04-26T18:08:47.144960+0000","last_deep_scrub":"36'644","last_deep_scrub_stamp":"2024-04-26T18:08:47.144960+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.144960+0000","objects_scrubbed":306,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:24.600380+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"36'82","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.374586+0000","last_change":"2024-04-26T18:08:37.374586+0000","last_active":"2024-04-26T18:08:37.374586+0000","last_peered":"2024-04-26T18:08:37.374586+0000","last_clean":"2024-04-26T18:08:37.374586+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:08:37.374586+0000","last_undegraded":"2024-04-26T18:08:37.374586+0000","last_fullsized":"2024-04-26T18:08:37.374586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-04-26T18:08:37.374407+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-04-26T18:08:37.374407+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.374407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:08.627829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'253","reported_seq":313,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.614502+0000","last_change":"2024-04-26T18:08:43.614534+0000","last_active":"2024-04-26T18:08:43.614502+0000","last_peered":"2024-04-26T18:08:43.614502+0000","last_clean":"2024-04-26T18:08:43.614502+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:08:43.614502+0000","last_undegraded":"2024-04-26T18:08:43.614502+0000","last_fullsized":"2024-04-26T18:08:43.614502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'253","last_scrub_stamp":"2024-04-26T18:08:43.614429+0000","last_deep_scrub":"36'253","last_deep_scrub_stamp":"2024-04-26T18:08:43.614429+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.614429+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:13.255566+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2846,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.541273+0000","last_change":"2024-04-26T18:08:47.541322+0000","last_active":"2024-04-26T18:08:47.541273+0000","last_peered":"2024-04-26T18:08:47.541273+0000","last_clean":"2024-04-26T18:08:47.541273+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:47.541273+0000","last_undegraded":"2024-04-26T18:08:47.541273+0000","last_fullsized":"2024-04-26T18:08:47.541273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'713","last_scrub_stamp":"2024-04-26T18:08:47.541187+0000","last_deep_scrub":"36'713","last_deep_scrub_stamp":"2024-04-26T18:08:47.541187+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.541187+0000","objects_scrubbed":346,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:57.186986+0000","scrub_duration":124,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.555862+0000","last_change":"2024-04-26T18:08:46.555884+0000","last_active":"2024-04-26T18:08:46.555862+0000","last_peered":"2024-04-26T18:08:46.555862+0000","last_clean":"2024-04-26T18:08:46.555862+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:08:46.555862+0000","last_undegraded":"2024-04-26T18:08:46.555862+0000","last_fullsized":"2024-04-26T18:08:46.555862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:46.555802+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:46.555802+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.555802+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:26.734743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'114","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.273786+0000","last_change":"2024-04-26T18:08:37.273815+0000","last_active":"2024-04-26T18:08:37.273786+0000","last_peered":"2024-04-26T18:08:37.273786+0000","last_clean":"2024-04-26T18:08:37.273786+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:08:37.273786+0000","last_undegraded":"2024-04-26T18:08:37.273786+0000","last_fullsized":"2024-04-26T18:08:37.273786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'114","last_scrub_stamp":"2024-04-26T18:08:37.273704+0000","last_deep_scrub":"36'114","last_deep_scrub_stamp":"2024-04-26T18:08:37.273704+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.273704+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:51.384474+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14568,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.441015+0000","last_change":"2024-04-26T18:08:37.441058+0000","last_active":"2024-04-26T18:08:37.441015+0000","last_peered":"2024-04-26T18:08:37.441015+0000","last_clean":"2024-04-26T18:08:37.441015+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:08:37.441015+0000","last_undegraded":"2024-04-26T18:08:37.441015+0000","last_fullsized":"2024-04-26T18:08:37.441015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-26T18:08:37.440924+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-26T18:08:37.440924+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.440924+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:03.288148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.287474+0000","last_change":"2024-04-26T18:08:49.287525+0000","last_active":"2024-04-26T18:08:49.287474+0000","last_peered":"2024-04-26T18:08:49.287474+0000","last_clean":"2024-04-26T18:08:49.287474+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:49.287474+0000","last_undegraded":"2024-04-26T18:08:49.287474+0000","last_fullsized":"2024-04-26T18:08:49.287474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'686","last_scrub_stamp":"2024-04-26T18:08:49.287381+0000","last_deep_scrub":"36'686","last_deep_scrub_stamp":"2024-04-26T18:08:49.287381+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.287381+0000","objects_scrubbed":379,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:54.958835+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.671240+0000","last_change":"2024-04-26T18:08:46.671263+0000","last_active":"2024-04-26T18:08:46.671240+0000","last_peered":"2024-04-26T18:08:46.671240+0000","last_clean":"2024-04-26T18:08:46.671240+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:08:46.671240+0000","last_undegraded":"2024-04-26T18:08:46.671240+0000","last_fullsized":"2024-04-26T18:08:46.671240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:46.671164+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:46.671164+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.671164+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:14.165417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'341","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.524851+0000","last_change":"2024-04-26T18:08:35.524879+0000","last_active":"2024-04-26T18:08:35.524851+0000","last_peered":"2024-04-26T18:08:35.524851+0000","last_clean":"2024-04-26T18:08:35.524851+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:35.524851+0000","last_undegraded":"2024-04-26T18:08:35.524851+0000","last_fullsized":"2024-04-26T18:08:35.524851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'341","last_scrub_stamp":"2024-04-26T18:08:35.524787+0000","last_deep_scrub":"36'341","last_deep_scrub_stamp":"2024-04-26T18:08:35.524787+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.524787+0000","objects_scrubbed":4,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:19.752481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23627,"num_omap_keys":39,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2812,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.266962+0000","last_change":"2024-04-26T18:08:48.267005+0000","last_active":"2024-04-26T18:08:48.266962+0000","last_peered":"2024-04-26T18:08:48.266962+0000","last_clean":"2024-04-26T18:08:48.266962+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:48.266962+0000","last_undegraded":"2024-04-26T18:08:48.266962+0000","last_fullsized":"2024-04-26T18:08:48.266962+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'694","last_scrub_stamp":"2024-04-26T18:08:48.266879+0000","last_deep_scrub":"36'694","last_deep_scrub_stamp":"2024-04-26T18:08:48.266879+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.266879+0000","objects_scrubbed":344,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:38.547671+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'96","reported_seq":2173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.328501+0000","last_change":"2024-04-26T18:08:41.328522+0000","last_active":"2024-04-26T18:08:41.328501+0000","last_peered":"2024-04-26T18:08:41.328501+0000","last_clean":"2024-04-26T18:08:41.328501+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:08:41.328501+0000","last_undegraded":"2024-04-26T18:08:41.328501+0000","last_fullsized":"2024-04-26T18:08:41.328501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-04-26T18:08:41.328433+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-04-26T18:08:41.328433+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.328433+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:49:16.627314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.874892+0000","last_change":"2024-04-26T18:08:34.874924+0000","last_active":"2024-04-26T18:08:34.874892+0000","last_peered":"2024-04-26T18:08:34.874892+0000","last_clean":"2024-04-26T18:08:34.874892+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:34.874892+0000","last_undegraded":"2024-04-26T18:08:34.874892+0000","last_fullsized":"2024-04-26T18:08:34.874892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-04-26T18:08:34.874814+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-04-26T18:08:34.874814+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.874814+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:55.613011+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36218,"num_omap_keys":62,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.556130+0000","last_change":"2024-04-26T18:08:45.556166+0000","last_active":"2024-04-26T18:08:45.556130+0000","last_peered":"2024-04-26T18:08:45.556130+0000","last_clean":"2024-04-26T18:08:45.556130+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:45.556130+0000","last_undegraded":"2024-04-26T18:08:45.556130+0000","last_fullsized":"2024-04-26T18:08:45.556130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'661","last_scrub_stamp":"2024-04-26T18:08:45.556049+0000","last_deep_scrub":"36'661","last_deep_scrub_stamp":"2024-04-26T18:08:45.556049+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.556049+0000","objects_scrubbed":334,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:18.770571+0000","scrub_duration":105,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"36'87","reported_seq":2165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.635344+0000","last_change":"2024-04-26T18:08:49.635383+0000","last_active":"2024-04-26T18:08:49.635344+0000","last_peered":"2024-04-26T18:08:49.635344+0000","last_clean":"2024-04-26T18:08:49.635344+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:08:49.635344+0000","last_undegraded":"2024-04-26T18:08:49.635344+0000","last_fullsized":"2024-04-26T18:08:49.635344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-04-26T18:08:49.635251+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-04-26T18:08:49.635251+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.635251+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.544680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'116","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.518753+0000","last_change":"2024-04-26T18:08:34.518798+0000","last_active":"2024-04-26T18:08:34.518753+0000","last_peered":"2024-04-26T18:08:34.518753+0000","last_clean":"2024-04-26T18:08:34.518753+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:34.518753+0000","last_undegraded":"2024-04-26T18:08:34.518753+0000","last_fullsized":"2024-04-26T18:08:34.518753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'116","last_scrub_stamp":"2024-04-26T18:08:34.518680+0000","last_deep_scrub":"36'116","last_deep_scrub_stamp":"2024-04-26T18:08:34.518680+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.518680+0000","objects_scrubbed":3,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:20.463081+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8487,"num_omap_keys":15,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2794,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.512956+0000","last_change":"2024-04-26T18:08:50.512987+0000","last_active":"2024-04-26T18:08:50.512956+0000","last_peered":"2024-04-26T18:08:50.512956+0000","last_clean":"2024-04-26T18:08:50.512956+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:50.512956+0000","last_undegraded":"2024-04-26T18:08:50.512956+0000","last_fullsized":"2024-04-26T18:08:50.512956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'672","last_scrub_stamp":"2024-04-26T18:08:50.512845+0000","last_deep_scrub":"36'672","last_deep_scrub_stamp":"2024-04-26T18:08:50.512845+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.512845+0000","objects_scrubbed":325,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:51.956159+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'66","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.644247+0000","last_change":"2024-04-26T18:08:47.644268+0000","last_active":"2024-04-26T18:08:47.644247+0000","last_peered":"2024-04-26T18:08:47.644247+0000","last_clean":"2024-04-26T18:08:47.644247+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:08:47.644247+0000","last_undegraded":"2024-04-26T18:08:47.644247+0000","last_fullsized":"2024-04-26T18:08:47.644247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-26T18:08:47.644178+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-26T18:08:47.644178+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.644178+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:32.449389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'66","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.089159+0000","last_change":"2024-04-26T18:08:34.089195+0000","last_active":"2024-04-26T18:08:34.089159+0000","last_peered":"2024-04-26T18:08:34.089159+0000","last_clean":"2024-04-26T18:08:34.089159+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:08:34.089159+0000","last_undegraded":"2024-04-26T18:08:34.089159+0000","last_fullsized":"2024-04-26T18:08:34.089159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-26T18:08:34.089065+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-26T18:08:34.089065+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.089065+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:22.700639+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23020,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2841,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.212131+0000","last_change":"2024-04-26T18:08:42.212164+0000","last_active":"2024-04-26T18:08:42.212131+0000","last_peered":"2024-04-26T18:08:42.212131+0000","last_clean":"2024-04-26T18:08:42.212131+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:42.212131+0000","last_undegraded":"2024-04-26T18:08:42.212131+0000","last_fullsized":"2024-04-26T18:08:42.212131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'698","last_scrub_stamp":"2024-04-26T18:08:42.212050+0000","last_deep_scrub":"36'698","last_deep_scrub_stamp":"2024-04-26T18:08:42.212050+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.212050+0000","objects_scrubbed":336,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:11.655082+0000","scrub_duration":140,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"36'90","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.627612+0000","last_change":"2024-04-26T18:08:45.627635+0000","last_active":"2024-04-26T18:08:45.627612+0000","last_peered":"2024-04-26T18:08:45.627612+0000","last_clean":"2024-04-26T18:08:45.627612+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:08:45.627612+0000","last_undegraded":"2024-04-26T18:08:45.627612+0000","last_fullsized":"2024-04-26T18:08:45.627612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:45.627541+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:45.627541+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.627541+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:50.259358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'78","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.538709+0000","last_change":"2024-04-26T18:08:36.538749+0000","last_active":"2024-04-26T18:08:36.538709+0000","last_peered":"2024-04-26T18:08:36.538709+0000","last_clean":"2024-04-26T18:08:36.538709+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:08:36.538709+0000","last_undegraded":"2024-04-26T18:08:36.538709+0000","last_fullsized":"2024-04-26T18:08:36.538709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'78","last_scrub_stamp":"2024-04-26T18:08:36.538625+0000","last_deep_scrub":"36'78","last_deep_scrub_stamp":"2024-04-26T18:08:36.538625+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.538625+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:41.869490+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6677,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2785,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.549726+0000","last_change":"2024-04-26T18:08:44.549773+0000","last_active":"2024-04-26T18:08:44.549726+0000","last_peered":"2024-04-26T18:08:44.549726+0000","last_clean":"2024-04-26T18:08:44.549726+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:44.549726+0000","last_undegraded":"2024-04-26T18:08:44.549726+0000","last_fullsized":"2024-04-26T18:08:44.549726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'663","last_scrub_stamp":"2024-04-26T18:08:44.549638+0000","last_deep_scrub":"36'663","last_deep_scrub_stamp":"2024-04-26T18:08:44.549638+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.549638+0000","objects_scrubbed":297,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:11.567301+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.187066+0000","last_change":"2024-04-26T18:08:43.187109+0000","last_active":"2024-04-26T18:08:43.187066+0000","last_peered":"2024-04-26T18:08:43.187066+0000","last_clean":"2024-04-26T18:08:43.187066+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:08:43.187066+0000","last_undegraded":"2024-04-26T18:08:43.187066+0000","last_fullsized":"2024-04-26T18:08:43.187066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:43.186981+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:43.186981+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.186981+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:23.669897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'5","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.061558+0000","last_change":"2024-04-26T18:08:38.061593+0000","last_active":"2024-04-26T18:08:38.061558+0000","last_peered":"2024-04-26T18:08:38.061558+0000","last_clean":"2024-04-26T18:08:38.061558+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:08:38.061558+0000","last_undegraded":"2024-04-26T18:08:38.061558+0000","last_fullsized":"2024-04-26T18:08:38.061558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-04-26T18:08:38.061463+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-04-26T18:08:38.061463+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.061463+0000","objects_scrubbed":3,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:58.668256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35068,"num_omap_keys":58,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.585887+0000","last_change":"2024-04-26T18:08:50.585914+0000","last_active":"2024-04-26T18:08:50.585887+0000","last_peered":"2024-04-26T18:08:50.585887+0000","last_clean":"2024-04-26T18:08:50.585887+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:50.585887+0000","last_undegraded":"2024-04-26T18:08:50.585887+0000","last_fullsized":"2024-04-26T18:08:50.585887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'651","last_scrub_stamp":"2024-04-26T18:08:50.585802+0000","last_deep_scrub":"36'651","last_deep_scrub_stamp":"2024-04-26T18:08:50.585802+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.585802+0000","objects_scrubbed":326,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:12.821329+0000","scrub_duration":116,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'101","reported_seq":2179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.363373+0000","last_change":"2024-04-26T18:08:35.363402+0000","last_active":"2024-04-26T18:08:35.363373+0000","last_peered":"2024-04-26T18:08:35.363373+0000","last_clean":"2024-04-26T18:08:35.363373+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:08:35.363373+0000","last_undegraded":"2024-04-26T18:08:35.363373+0000","last_fullsized":"2024-04-26T18:08:35.363373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'101","last_scrub_stamp":"2024-04-26T18:08:35.363288+0000","last_deep_scrub":"36'101","last_deep_scrub_stamp":"2024-04-26T18:08:35.363288+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.363288+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:14.215624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.310759+0000","last_change":"2024-04-26T18:08:38.310788+0000","last_active":"2024-04-26T18:08:38.310759+0000","last_peered":"2024-04-26T18:08:38.310759+0000","last_clean":"2024-04-26T18:08:38.310759+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:08:38.310759+0000","last_undegraded":"2024-04-26T18:08:38.310759+0000","last_fullsized":"2024-04-26T18:08:38.310759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:08:38.310653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:08:38.310653+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.310653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:53.217830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2721,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.621490+0000","last_change":"2024-04-26T18:08:49.621521+0000","last_active":"2024-04-26T18:08:49.621490+0000","last_peered":"2024-04-26T18:08:49.621490+0000","last_clean":"2024-04-26T18:08:49.621490+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:49.621490+0000","last_undegraded":"2024-04-26T18:08:49.621490+0000","last_fullsized":"2024-04-26T18:08:49.621490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'610","last_scrub_stamp":"2024-04-26T18:08:49.621409+0000","last_deep_scrub":"36'610","last_deep_scrub_stamp":"2024-04-26T18:08:49.621409+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.621409+0000","objects_scrubbed":311,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:32.751299+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.327640+0000","last_change":"2024-04-26T18:08:41.327663+0000","last_active":"2024-04-26T18:08:41.327640+0000","last_peered":"2024-04-26T18:08:41.327640+0000","last_clean":"2024-04-26T18:08:41.327640+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:08:41.327640+0000","last_undegraded":"2024-04-26T18:08:41.327640+0000","last_fullsized":"2024-04-26T18:08:41.327640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:41.327567+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:41.327567+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.327567+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:23.324119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.349150+0000","last_change":"2024-04-26T18:08:33.349202+0000","last_active":"2024-04-26T18:08:33.349150+0000","last_peered":"2024-04-26T18:08:33.349150+0000","last_clean":"2024-04-26T18:08:33.349150+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:08:33.349150+0000","last_undegraded":"2024-04-26T18:08:33.349150+0000","last_fullsized":"2024-04-26T18:08:33.349150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'19","last_scrub_stamp":"2024-04-26T18:08:33.349041+0000","last_deep_scrub":"36'19","last_deep_scrub_stamp":"2024-04-26T18:08:33.349041+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.349041+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:33.873287+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28494,"num_omap_keys":50,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2770,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.480541+0000","last_change":"2024-04-26T18:08:49.480587+0000","last_active":"2024-04-26T18:08:49.480541+0000","last_peered":"2024-04-26T18:08:49.480541+0000","last_clean":"2024-04-26T18:08:49.480541+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:49.480541+0000","last_undegraded":"2024-04-26T18:08:49.480541+0000","last_fullsized":"2024-04-26T18:08:49.480541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'644","last_scrub_stamp":"2024-04-26T18:08:49.480460+0000","last_deep_scrub":"36'644","last_deep_scrub_stamp":"2024-04-26T18:08:49.480460+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.480460+0000","objects_scrubbed":317,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:55.273955+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'83","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.646501+0000","last_change":"2024-04-26T18:08:50.646537+0000","last_active":"2024-04-26T18:08:50.646501+0000","last_peered":"2024-04-26T18:08:50.646501+0000","last_clean":"2024-04-26T18:08:50.646501+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:08:50.646501+0000","last_undegraded":"2024-04-26T18:08:50.646501+0000","last_fullsized":"2024-04-26T18:08:50.646501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:50.646427+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:50.646427+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.646427+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:12.376566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'166","reported_seq":225,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.134594+0000","last_change":"2024-04-26T18:08:35.134594+0000","last_active":"2024-04-26T18:08:35.134594+0000","last_peered":"2024-04-26T18:08:35.134594+0000","last_clean":"2024-04-26T18:08:35.134594+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:35.134594+0000","last_undegraded":"2024-04-26T18:08:35.134594+0000","last_fullsized":"2024-04-26T18:08:35.134594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'165","last_scrub_stamp":"2024-04-26T18:08:35.134470+0000","last_deep_scrub":"36'165","last_deep_scrub_stamp":"2024-04-26T18:08:35.134470+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.134470+0000","objects_scrubbed":9,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:16.404818+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":158,"num_write_kb":12430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34930,"num_omap_keys":58,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.118095+0000","last_change":"2024-04-26T18:08:48.118151+0000","last_active":"2024-04-26T18:08:48.118095+0000","last_peered":"2024-04-26T18:08:48.118095+0000","last_clean":"2024-04-26T18:08:48.118095+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:48.118095+0000","last_undegraded":"2024-04-26T18:08:48.118095+0000","last_fullsized":"2024-04-26T18:08:48.118095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'664","last_scrub_stamp":"2024-04-26T18:08:48.118000+0000","last_deep_scrub":"36'664","last_deep_scrub_stamp":"2024-04-26T18:08:48.118000+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.118000+0000","objects_scrubbed":331,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:10.365795+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'86","reported_seq":2164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.095654+0000","last_change":"2024-04-26T18:08:38.095681+0000","last_active":"2024-04-26T18:08:38.095654+0000","last_peered":"2024-04-26T18:08:38.095654+0000","last_clean":"2024-04-26T18:08:38.095654+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:08:38.095654+0000","last_undegraded":"2024-04-26T18:08:38.095654+0000","last_fullsized":"2024-04-26T18:08:38.095654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'86","last_scrub_stamp":"2024-04-26T18:08:38.095573+0000","last_deep_scrub":"36'86","last_deep_scrub_stamp":"2024-04-26T18:08:38.095573+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.095573+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:52.836709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'340","reported_seq":399,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.996033+0000","last_change":"2024-04-26T18:08:39.996066+0000","last_active":"2024-04-26T18:08:39.996033+0000","last_peered":"2024-04-26T18:08:39.996033+0000","last_clean":"2024-04-26T18:08:39.996033+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:39.996033+0000","last_undegraded":"2024-04-26T18:08:39.996033+0000","last_fullsized":"2024-04-26T18:08:39.996033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'340","last_scrub_stamp":"2024-04-26T18:08:39.995948+0000","last_deep_scrub":"36'340","last_deep_scrub_stamp":"2024-04-26T18:08:39.995948+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.995948+0000","objects_scrubbed":8,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:36.487613+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":12535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22652,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.273736+0000","last_change":"2024-04-26T18:08:48.273762+0000","last_active":"2024-04-26T18:08:48.273736+0000","last_peered":"2024-04-26T18:08:48.273736+0000","last_clean":"2024-04-26T18:08:48.273736+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:48.273736+0000","last_undegraded":"2024-04-26T18:08:48.273736+0000","last_fullsized":"2024-04-26T18:08:48.273736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'654","last_scrub_stamp":"2024-04-26T18:08:48.273665+0000","last_deep_scrub":"36'654","last_deep_scrub_stamp":"2024-04-26T18:08:48.273665+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.273665+0000","objects_scrubbed":329,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:05.742307+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'89","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.328878+0000","last_change":"2024-04-26T18:08:39.328904+0000","last_active":"2024-04-26T18:08:39.328878+0000","last_peered":"2024-04-26T18:08:39.328878+0000","last_clean":"2024-04-26T18:08:39.328878+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:08:39.328878+0000","last_undegraded":"2024-04-26T18:08:39.328878+0000","last_fullsized":"2024-04-26T18:08:39.328878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-04-26T18:08:39.328796+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-04-26T18:08:39.328796+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.328796+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:24.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'595","reported_seq":653,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.300350+0000","last_change":"2024-04-26T18:08:35.300387+0000","last_active":"2024-04-26T18:08:35.300350+0000","last_peered":"2024-04-26T18:08:35.300350+0000","last_clean":"2024-04-26T18:08:35.300350+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:35.300350+0000","last_undegraded":"2024-04-26T18:08:35.300350+0000","last_fullsized":"2024-04-26T18:08:35.300350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'595","last_scrub_stamp":"2024-04-26T18:08:35.300277+0000","last_deep_scrub":"36'595","last_deep_scrub_stamp":"2024-04-26T18:08:35.300277+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.300277+0000","objects_scrubbed":9,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:47.187338+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30957,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2830,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.656913+0000","last_change":"2024-04-26T18:08:47.656947+0000","last_active":"2024-04-26T18:08:47.656913+0000","last_peered":"2024-04-26T18:08:47.656913+0000","last_clean":"2024-04-26T18:08:47.656913+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:47.656913+0000","last_undegraded":"2024-04-26T18:08:47.656913+0000","last_fullsized":"2024-04-26T18:08:47.656913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'704","last_scrub_stamp":"2024-04-26T18:08:47.656825+0000","last_deep_scrub":"36'704","last_deep_scrub_stamp":"2024-04-26T18:08:47.656825+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.656825+0000","objects_scrubbed":354,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:32.572949+0000","scrub_duration":138,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'105","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.434000+0000","last_change":"2024-04-26T18:08:41.434028+0000","last_active":"2024-04-26T18:08:41.434000+0000","last_peered":"2024-04-26T18:08:41.434000+0000","last_clean":"2024-04-26T18:08:41.434000+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:08:41.434000+0000","last_undegraded":"2024-04-26T18:08:41.434000+0000","last_fullsized":"2024-04-26T18:08:41.434000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'105","last_scrub_stamp":"2024-04-26T18:08:41.433911+0000","last_deep_scrub":"36'105","last_deep_scrub_stamp":"2024-04-26T18:08:41.433911+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.433911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:55.230156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'5","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.032309+0000","last_change":"2024-04-26T18:08:37.032356+0000","last_active":"2024-04-26T18:08:37.032309+0000","last_peered":"2024-04-26T18:08:37.032309+0000","last_clean":"2024-04-26T18:08:37.032309+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:08:37.032309+0000","last_undegraded":"2024-04-26T18:08:37.032309+0000","last_fullsized":"2024-04-26T18:08:37.032309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-04-26T18:08:37.032204+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-04-26T18:08:37.032204+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.032204+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:54.630469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18977,"num_omap_keys":32,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2806,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:26.708210+0000","last_change":"2024-04-26T18:03:24.993538+0000","last_active":"2024-04-26T18:08:26.708210+0000","last_peered":"2024-04-26T18:08:26.708210+0000","last_clean":"2024-04-26T18:08:26.708210+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:26.708210+0000","last_undegraded":"2024-04-26T18:08:26.708210+0000","last_fullsized":"2024-04-26T18:08:26.708210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:16.502090+0000","last_clean_scrub_stamp":"2024-04-26T17:58:16.502090+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2783,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.579876+0000","last_change":"2024-04-26T18:08:48.579909+0000","last_active":"2024-04-26T18:08:48.579876+0000","last_peered":"2024-04-26T18:08:48.579876+0000","last_clean":"2024-04-26T18:08:48.579876+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:48.579876+0000","last_undegraded":"2024-04-26T18:08:48.579876+0000","last_fullsized":"2024-04-26T18:08:48.579876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'660","last_scrub_stamp":"2024-04-26T18:08:48.579798+0000","last_deep_scrub":"36'660","last_deep_scrub_stamp":"2024-04-26T18:08:48.579798+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.579798+0000","objects_scrubbed":336,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:08.351222+0000","scrub_duration":126,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'93","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.910675+0000","last_change":"2024-04-26T18:08:43.910707+0000","last_active":"2024-04-26T18:08:43.910675+0000","last_peered":"2024-04-26T18:08:43.910675+0000","last_clean":"2024-04-26T18:08:43.910675+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:08:43.910675+0000","last_undegraded":"2024-04-26T18:08:43.910675+0000","last_fullsized":"2024-04-26T18:08:43.910675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:43.910584+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:43.910584+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.910584+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:52.379335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'59","reported_seq":117,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.291127+0000","last_change":"2024-04-26T18:08:36.291163+0000","last_active":"2024-04-26T18:08:36.291127+0000","last_peered":"2024-04-26T18:08:36.291127+0000","last_clean":"2024-04-26T18:08:36.291127+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:36.291127+0000","last_undegraded":"2024-04-26T18:08:36.291127+0000","last_fullsized":"2024-04-26T18:08:36.291127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'59","last_scrub_stamp":"2024-04-26T18:08:36.291050+0000","last_deep_scrub":"36'59","last_deep_scrub_stamp":"2024-04-26T18:08:36.291050+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.291050+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:56.422369+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23397,"num_omap_keys":39,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2781,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.289457+0000","last_change":"2024-04-26T18:08:47.289515+0000","last_active":"2024-04-26T18:08:47.289457+0000","last_peered":"2024-04-26T18:08:47.289457+0000","last_clean":"2024-04-26T18:08:47.289457+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:47.289457+0000","last_undegraded":"2024-04-26T18:08:47.289457+0000","last_fullsized":"2024-04-26T18:08:47.289457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'655","last_scrub_stamp":"2024-04-26T18:08:47.289338+0000","last_deep_scrub":"36'655","last_deep_scrub_stamp":"2024-04-26T18:08:47.289338+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.289338+0000","objects_scrubbed":332,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:58.635987+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'110","reported_seq":2188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.523697+0000","last_change":"2024-04-26T18:08:45.523751+0000","last_active":"2024-04-26T18:08:45.523697+0000","last_peered":"2024-04-26T18:08:45.523697+0000","last_clean":"2024-04-26T18:08:45.523697+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:08:45.523697+0000","last_undegraded":"2024-04-26T18:08:45.523697+0000","last_fullsized":"2024-04-26T18:08:45.523697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'110","last_scrub_stamp":"2024-04-26T18:08:45.523611+0000","last_deep_scrub":"36'110","last_deep_scrub_stamp":"2024-04-26T18:08:45.523611+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.523611+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.576452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'27","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.511615+0000","last_change":"2024-04-26T18:08:38.511651+0000","last_active":"2024-04-26T18:08:38.511615+0000","last_peered":"2024-04-26T18:08:38.511615+0000","last_clean":"2024-04-26T18:08:38.511615+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:08:38.511615+0000","last_undegraded":"2024-04-26T18:08:38.511615+0000","last_fullsized":"2024-04-26T18:08:38.511615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'27","last_scrub_stamp":"2024-04-26T18:08:38.511525+0000","last_deep_scrub":"36'27","last_deep_scrub_stamp":"2024-04-26T18:08:38.511525+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.511525+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:41.431052+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7886,"num_omap_keys":14,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1615","reported_seq":1674,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.515071+0000","last_change":"2024-04-26T18:08:39.133009+0000","last_active":"2024-04-26T18:08:49.515071+0000","last_peered":"2024-04-26T18:08:49.515071+0000","last_clean":"2024-04-26T18:08:49.515071+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:08:49.515071+0000","last_undegraded":"2024-04-26T18:08:49.515071+0000","last_fullsized":"2024-04-26T18:08:49.515071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1580","last_scrub_stamp":"2024-04-26T18:08:39.132880+0000","last_deep_scrub":"36'1580","last_deep_scrub_stamp":"2024-04-26T18:08:39.132880+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.132880+0000","objects_scrubbed":6,"log_size":1615,"log_dups_size":0,"ondisk_log_size":1615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:40.656186+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19728638,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1608,"num_write_kb":20428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'91","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.381965+0000","last_change":"2024-04-26T18:08:36.381992+0000","last_active":"2024-04-26T18:08:36.381965+0000","last_peered":"2024-04-26T18:08:36.381965+0000","last_clean":"2024-04-26T18:08:36.381965+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:08:36.381965+0000","last_undegraded":"2024-04-26T18:08:36.381965+0000","last_fullsized":"2024-04-26T18:08:36.381965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:36.381891+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:36.381891+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.381891+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:33.673810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.562250+0000","last_change":"2024-04-26T18:08:39.562286+0000","last_active":"2024-04-26T18:08:39.562250+0000","last_peered":"2024-04-26T18:08:39.562250+0000","last_clean":"2024-04-26T18:08:39.562250+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:39.562250+0000","last_undegraded":"2024-04-26T18:08:39.562250+0000","last_fullsized":"2024-04-26T18:08:39.562250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'646","last_scrub_stamp":"2024-04-26T18:08:39.562161+0000","last_deep_scrub":"36'646","last_deep_scrub_stamp":"2024-04-26T18:08:39.562161+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.562161+0000","objects_scrubbed":342,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:04.607634+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'56","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.512629+0000","last_change":"2024-04-26T18:08:39.512659+0000","last_active":"2024-04-26T18:08:39.512629+0000","last_peered":"2024-04-26T18:08:39.512629+0000","last_clean":"2024-04-26T18:08:39.512629+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:08:39.512629+0000","last_undegraded":"2024-04-26T18:08:39.512629+0000","last_fullsized":"2024-04-26T18:08:39.512629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'56","last_scrub_stamp":"2024-04-26T18:08:39.512559+0000","last_deep_scrub":"36'56","last_deep_scrub_stamp":"2024-04-26T18:08:39.512559+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.512559+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:01.864596+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11569,"num_omap_keys":19,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.073960+0000","last_change":"2024-04-26T18:08:39.074001+0000","last_active":"2024-04-26T18:08:39.073960+0000","last_peered":"2024-04-26T18:08:39.073960+0000","last_clean":"2024-04-26T18:08:39.073960+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:08:39.073960+0000","last_undegraded":"2024-04-26T18:08:39.073960+0000","last_fullsized":"2024-04-26T18:08:39.073960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:39.073851+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:39.073851+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.073851+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:43.431262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2781,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.620043+0000","last_change":"2024-04-26T18:08:48.620107+0000","last_active":"2024-04-26T18:08:48.620043+0000","last_peered":"2024-04-26T18:08:48.620043+0000","last_clean":"2024-04-26T18:08:48.620043+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:48.620043+0000","last_undegraded":"2024-04-26T18:08:48.620043+0000","last_fullsized":"2024-04-26T18:08:48.620043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'650","last_scrub_stamp":"2024-04-26T18:08:48.619906+0000","last_deep_scrub":"36'650","last_deep_scrub_stamp":"2024-04-26T18:08:48.619906+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.619906+0000","objects_scrubbed":319,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:38.433494+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'107","reported_seq":2186,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.185265+0000","last_change":"2024-04-26T18:08:45.185295+0000","last_active":"2024-04-26T18:08:45.185265+0000","last_peered":"2024-04-26T18:08:45.185265+0000","last_clean":"2024-04-26T18:08:45.185265+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:08:45.185265+0000","last_undegraded":"2024-04-26T18:08:45.185265+0000","last_fullsized":"2024-04-26T18:08:45.185265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'107","last_scrub_stamp":"2024-04-26T18:08:45.185165+0000","last_deep_scrub":"36'107","last_deep_scrub_stamp":"2024-04-26T18:08:45.185165+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.185165+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:33.979510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"36'110","reported_seq":2189,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.451349+0000","last_change":"2024-04-26T18:08:38.451349+0000","last_active":"2024-04-26T18:08:38.451349+0000","last_peered":"2024-04-26T18:08:38.451349+0000","last_clean":"2024-04-26T18:08:38.451349+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:08:38.451349+0000","last_undegraded":"2024-04-26T18:08:38.451349+0000","last_fullsized":"2024-04-26T18:08:38.451349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'110","last_scrub_stamp":"2024-04-26T18:08:38.451211+0000","last_deep_scrub":"36'110","last_deep_scrub_stamp":"2024-04-26T18:08:38.451211+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.451211+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:42.122218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'102","reported_seq":2180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.366485+0000","last_change":"2024-04-26T18:08:47.366504+0000","last_active":"2024-04-26T18:08:47.366485+0000","last_peered":"2024-04-26T18:08:47.366485+0000","last_clean":"2024-04-26T18:08:47.366485+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:08:47.366485+0000","last_undegraded":"2024-04-26T18:08:47.366485+0000","last_fullsized":"2024-04-26T18:08:47.366485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-26T18:08:47.366409+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-26T18:08:47.366409+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.366409+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:36.531315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"36'99","reported_seq":2178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.326641+0000","last_change":"2024-04-26T18:08:38.326641+0000","last_active":"2024-04-26T18:08:38.326641+0000","last_peered":"2024-04-26T18:08:38.326641+0000","last_clean":"2024-04-26T18:08:38.326641+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:08:38.326641+0000","last_undegraded":"2024-04-26T18:08:38.326641+0000","last_fullsized":"2024-04-26T18:08:38.326641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-04-26T18:08:38.326511+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-04-26T18:08:38.326511+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.326511+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:51.091796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'79","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.528681+0000","last_change":"2024-04-26T18:08:41.528708+0000","last_active":"2024-04-26T18:08:41.528681+0000","last_peered":"2024-04-26T18:08:41.528681+0000","last_clean":"2024-04-26T18:08:41.528681+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:08:41.528681+0000","last_undegraded":"2024-04-26T18:08:41.528681+0000","last_fullsized":"2024-04-26T18:08:41.528681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'79","last_scrub_stamp":"2024-04-26T18:08:41.528593+0000","last_deep_scrub":"36'79","last_deep_scrub_stamp":"2024-04-26T18:08:41.528593+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.528593+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:09.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'74","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.922851+0000","last_change":"2024-04-26T18:08:42.922879+0000","last_active":"2024-04-26T18:08:42.922851+0000","last_peered":"2024-04-26T18:08:42.922851+0000","last_clean":"2024-04-26T18:08:42.922851+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:08:42.922851+0000","last_undegraded":"2024-04-26T18:08:42.922851+0000","last_fullsized":"2024-04-26T18:08:42.922851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-26T18:08:42.922749+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-26T18:08:42.922749+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.922749+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:41.128014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"36'109","reported_seq":2187,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.165362+0000","last_change":"2024-04-26T18:08:46.165384+0000","last_active":"2024-04-26T18:08:46.165362+0000","last_peered":"2024-04-26T18:08:46.165362+0000","last_clean":"2024-04-26T18:08:46.165362+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:08:46.165362+0000","last_undegraded":"2024-04-26T18:08:46.165362+0000","last_fullsized":"2024-04-26T18:08:46.165362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'109","last_scrub_stamp":"2024-04-26T18:08:46.165287+0000","last_deep_scrub":"36'109","last_deep_scrub_stamp":"2024-04-26T18:08:46.165287+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.165287+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:53.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'83","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.489696+0000","last_change":"2024-04-26T18:08:37.489725+0000","last_active":"2024-04-26T18:08:37.489696+0000","last_peered":"2024-04-26T18:08:37.489696+0000","last_clean":"2024-04-26T18:08:37.489696+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:08:37.489696+0000","last_undegraded":"2024-04-26T18:08:37.489696+0000","last_fullsized":"2024-04-26T18:08:37.489696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:37.489600+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:37.489600+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.489600+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:21.970320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'91","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.338627+0000","last_change":"2024-04-26T18:08:43.338650+0000","last_active":"2024-04-26T18:08:43.338627+0000","last_peered":"2024-04-26T18:08:43.338627+0000","last_clean":"2024-04-26T18:08:43.338627+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:08:43.338627+0000","last_undegraded":"2024-04-26T18:08:43.338627+0000","last_fullsized":"2024-04-26T18:08:43.338627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:43.338554+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:43.338554+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.338554+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:25.048151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.459478+0000","last_change":"2024-04-26T18:08:34.459533+0000","last_active":"2024-04-26T18:08:34.459478+0000","last_peered":"2024-04-26T18:08:34.459478+0000","last_clean":"2024-04-26T18:08:34.459478+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:08:34.459478+0000","last_undegraded":"2024-04-26T18:08:34.459478+0000","last_fullsized":"2024-04-26T18:08:34.459478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:34.459396+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:34.459396+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.459396+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:33.197157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'95","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.445082+0000","last_change":"2024-04-26T18:08:42.445104+0000","last_active":"2024-04-26T18:08:42.445082+0000","last_peered":"2024-04-26T18:08:42.445082+0000","last_clean":"2024-04-26T18:08:42.445082+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:08:42.445082+0000","last_undegraded":"2024-04-26T18:08:42.445082+0000","last_fullsized":"2024-04-26T18:08:42.445082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'95","last_scrub_stamp":"2024-04-26T18:08:42.445016+0000","last_deep_scrub":"36'95","last_deep_scrub_stamp":"2024-04-26T18:08:42.445016+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.445016+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:12.913061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'90","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:32.349724+0000","last_change":"2024-04-26T18:08:32.349755+0000","last_active":"2024-04-26T18:08:32.349724+0000","last_peered":"2024-04-26T18:08:32.349724+0000","last_clean":"2024-04-26T18:08:32.349724+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:08:32.349724+0000","last_undegraded":"2024-04-26T18:08:32.349724+0000","last_fullsized":"2024-04-26T18:08:32.349724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:32.349651+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:32.349651+0000","last_clean_scrub_stamp":"2024-04-26T18:08:32.349651+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:48.245363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'98","reported_seq":2176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.228183+0000","last_change":"2024-04-26T18:08:44.228221+0000","last_active":"2024-04-26T18:08:44.228183+0000","last_peered":"2024-04-26T18:08:44.228183+0000","last_clean":"2024-04-26T18:08:44.228183+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:08:44.228183+0000","last_undegraded":"2024-04-26T18:08:44.228183+0000","last_fullsized":"2024-04-26T18:08:44.228183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-04-26T18:08:44.228097+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-04-26T18:08:44.228097+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.228097+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:49.180562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.403372+0000","last_change":"2024-04-26T18:08:36.403411+0000","last_active":"2024-04-26T18:08:36.403372+0000","last_peered":"2024-04-26T18:08:36.403372+0000","last_clean":"2024-04-26T18:08:36.403372+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:08:36.403372+0000","last_undegraded":"2024-04-26T18:08:36.403372+0000","last_fullsized":"2024-04-26T18:08:36.403372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:36.403267+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:36.403267+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.403267+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:17.707113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.486854+0000","last_change":"2024-04-26T18:08:37.486882+0000","last_active":"2024-04-26T18:08:37.486854+0000","last_peered":"2024-04-26T18:08:37.486854+0000","last_clean":"2024-04-26T18:08:37.486854+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:08:37.486854+0000","last_undegraded":"2024-04-26T18:08:37.486854+0000","last_fullsized":"2024-04-26T18:08:37.486854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:37.486765+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:37.486765+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.486765+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:26:44.560768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'94","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.378735+0000","last_change":"2024-04-26T18:08:46.378758+0000","last_active":"2024-04-26T18:08:46.378735+0000","last_peered":"2024-04-26T18:08:46.378735+0000","last_clean":"2024-04-26T18:08:46.378735+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:08:46.378735+0000","last_undegraded":"2024-04-26T18:08:46.378735+0000","last_fullsized":"2024-04-26T18:08:46.378735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'94","last_scrub_stamp":"2024-04-26T18:08:46.378648+0000","last_deep_scrub":"36'94","last_deep_scrub_stamp":"2024-04-26T18:08:46.378648+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.378648+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:21.678978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'97","reported_seq":2174,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.334757+0000","last_change":"2024-04-26T18:08:40.334780+0000","last_active":"2024-04-26T18:08:40.334757+0000","last_peered":"2024-04-26T18:08:40.334757+0000","last_clean":"2024-04-26T18:08:40.334757+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:08:40.334757+0000","last_undegraded":"2024-04-26T18:08:40.334757+0000","last_fullsized":"2024-04-26T18:08:40.334757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-04-26T18:08:40.334684+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-04-26T18:08:40.334684+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.334684+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:30.453975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.899172+0000","last_change":"2024-04-26T18:08:33.899194+0000","last_active":"2024-04-26T18:08:33.899172+0000","last_peered":"2024-04-26T18:08:33.899172+0000","last_clean":"2024-04-26T18:08:33.899172+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:08:33.899172+0000","last_undegraded":"2024-04-26T18:08:33.899172+0000","last_fullsized":"2024-04-26T18:08:33.899172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:33.899105+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:33.899105+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.899105+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:58.096182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.392865+0000","last_change":"2024-04-26T18:08:43.392888+0000","last_active":"2024-04-26T18:08:43.392865+0000","last_peered":"2024-04-26T18:08:43.392865+0000","last_clean":"2024-04-26T18:08:43.392865+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:08:43.392865+0000","last_undegraded":"2024-04-26T18:08:43.392865+0000","last_fullsized":"2024-04-26T18:08:43.392865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:43.392793+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:43.392793+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.392793+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:35.560219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"36'81","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.557341+0000","last_change":"2024-04-26T18:08:44.557362+0000","last_active":"2024-04-26T18:08:44.557341+0000","last_peered":"2024-04-26T18:08:44.557341+0000","last_clean":"2024-04-26T18:08:44.557341+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:08:44.557341+0000","last_undegraded":"2024-04-26T18:08:44.557341+0000","last_fullsized":"2024-04-26T18:08:44.557341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-04-26T18:08:44.557259+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-04-26T18:08:44.557259+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.557259+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:21.191378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'76","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.066154+0000","last_change":"2024-04-26T18:08:37.066177+0000","last_active":"2024-04-26T18:08:37.066154+0000","last_peered":"2024-04-26T18:08:37.066154+0000","last_clean":"2024-04-26T18:08:37.066154+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:08:37.066154+0000","last_undegraded":"2024-04-26T18:08:37.066154+0000","last_fullsized":"2024-04-26T18:08:37.066154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'76","last_scrub_stamp":"2024-04-26T18:08:37.066082+0000","last_deep_scrub":"36'76","last_deep_scrub_stamp":"2024-04-26T18:08:37.066082+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.066082+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:21.056477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'91","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.173555+0000","last_change":"2024-04-26T18:08:41.173590+0000","last_active":"2024-04-26T18:08:41.173555+0000","last_peered":"2024-04-26T18:08:41.173555+0000","last_clean":"2024-04-26T18:08:41.173555+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:08:41.173555+0000","last_undegraded":"2024-04-26T18:08:41.173555+0000","last_fullsized":"2024-04-26T18:08:41.173555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:41.173486+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:41.173486+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.173486+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.856659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'99","reported_seq":2177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.124050+0000","last_change":"2024-04-26T18:08:40.124071+0000","last_active":"2024-04-26T18:08:40.124050+0000","last_peered":"2024-04-26T18:08:40.124050+0000","last_clean":"2024-04-26T18:08:40.124050+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:08:40.124050+0000","last_undegraded":"2024-04-26T18:08:40.124050+0000","last_fullsized":"2024-04-26T18:08:40.124050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-04-26T18:08:40.123979+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-04-26T18:08:40.123979+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.123979+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:59.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'84","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:51.639986+0000","last_change":"2024-04-26T18:08:51.640013+0000","last_active":"2024-04-26T18:08:51.639986+0000","last_peered":"2024-04-26T18:08:51.639986+0000","last_clean":"2024-04-26T18:08:51.639986+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:08:51.639986+0000","last_undegraded":"2024-04-26T18:08:51.639986+0000","last_fullsized":"2024-04-26T18:08:51.639986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-04-26T18:08:51.639914+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-04-26T18:08:51.639914+0000","last_clean_scrub_stamp":"2024-04-26T18:08:51.639914+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:44.175665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"36'74","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.488628+0000","last_change":"2024-04-26T18:08:36.488653+0000","last_active":"2024-04-26T18:08:36.488628+0000","last_peered":"2024-04-26T18:08:36.488628+0000","last_clean":"2024-04-26T18:08:36.488628+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:08:36.488628+0000","last_undegraded":"2024-04-26T18:08:36.488628+0000","last_fullsized":"2024-04-26T18:08:36.488628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-26T18:08:36.488545+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-26T18:08:36.488545+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.488545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:52.627228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'104","reported_seq":2182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.661854+0000","last_change":"2024-04-26T18:08:48.661874+0000","last_active":"2024-04-26T18:08:48.661854+0000","last_peered":"2024-04-26T18:08:48.661854+0000","last_clean":"2024-04-26T18:08:48.661854+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:08:48.661854+0000","last_undegraded":"2024-04-26T18:08:48.661854+0000","last_fullsized":"2024-04-26T18:08:48.661854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'104","last_scrub_stamp":"2024-04-26T18:08:48.661784+0000","last_deep_scrub":"36'104","last_deep_scrub_stamp":"2024-04-26T18:08:48.661784+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.661784+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:10.058873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"36'92","reported_seq":2155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.421999+0000","last_change":"2024-04-26T18:08:40.422026+0000","last_active":"2024-04-26T18:08:40.421999+0000","last_peered":"2024-04-26T18:08:40.421999+0000","last_clean":"2024-04-26T18:08:40.421999+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:08:40.421999+0000","last_undegraded":"2024-04-26T18:08:40.421999+0000","last_fullsized":"2024-04-26T18:08:40.421999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:40.421918+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:40.421918+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.421918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:47.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"36'102","reported_seq":2180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.620645+0000","last_change":"2024-04-26T18:08:44.620667+0000","last_active":"2024-04-26T18:08:44.620645+0000","last_peered":"2024-04-26T18:08:44.620645+0000","last_clean":"2024-04-26T18:08:44.620645+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:08:44.620645+0000","last_undegraded":"2024-04-26T18:08:44.620645+0000","last_fullsized":"2024-04-26T18:08:44.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-26T18:08:44.620580+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-26T18:08:44.620580+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.620580+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:46.700611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'76","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.323527+0000","last_change":"2024-04-26T18:08:48.323568+0000","last_active":"2024-04-26T18:08:48.323527+0000","last_peered":"2024-04-26T18:08:48.323527+0000","last_clean":"2024-04-26T18:08:48.323527+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:08:48.323527+0000","last_undegraded":"2024-04-26T18:08:48.323527+0000","last_fullsized":"2024-04-26T18:08:48.323527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'76","last_scrub_stamp":"2024-04-26T18:08:48.323445+0000","last_deep_scrub":"36'76","last_deep_scrub_stamp":"2024-04-26T18:08:48.323445+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.323445+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:24.857135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.376829+0000","last_change":"2024-04-26T18:08:35.376829+0000","last_active":"2024-04-26T18:08:35.376829+0000","last_peered":"2024-04-26T18:08:35.376829+0000","last_clean":"2024-04-26T18:08:35.376829+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:08:35.376829+0000","last_undegraded":"2024-04-26T18:08:35.376829+0000","last_fullsized":"2024-04-26T18:08:35.376829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:35.376736+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:35.376736+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.376736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:46.679519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'75","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:32.864655+0000","last_change":"2024-04-26T18:08:32.864655+0000","last_active":"2024-04-26T18:08:32.864655+0000","last_peered":"2024-04-26T18:08:32.864655+0000","last_clean":"2024-04-26T18:08:32.864655+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:08:32.864655+0000","last_undegraded":"2024-04-26T18:08:32.864655+0000","last_fullsized":"2024-04-26T18:08:32.864655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-04-26T18:08:32.864504+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-04-26T18:08:32.864504+0000","last_clean_scrub_stamp":"2024-04-26T18:08:32.864504+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:17.483171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"36'86","reported_seq":2157,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.293022+0000","last_change":"2024-04-26T18:03:24.945776+0000","last_active":"2024-04-26T18:08:35.293022+0000","last_peered":"2024-04-26T18:08:35.293022+0000","last_clean":"2024-04-26T18:08:35.293022+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:08:35.293022+0000","last_undegraded":"2024-04-26T18:08:35.293022+0000","last_fullsized":"2024-04-26T18:08:35.293022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T17:58:12.469172+0000","last_clean_scrub_stamp":"2024-04-26T17:58:12.469172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5776,"ondisk_log_size":5776,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":238410398,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8810,"num_write_kb":241731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":665880,"num_omap_keys":1113,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":476880896,"data_stored":476820796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8556,"ondisk_log_size":8556,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374264,"kb_used_data":288944,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93997576,"statfs":{"total":96636764160,"available":96253517824,"internally_reserved":0,"allocated":295878656,"data_stored":295659565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450080,"kb_used_data":338456,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93921760,"statfs":{"total":96636764160,"available":96175882240,"internally_reserved":0,"allocated":346578944,"data_stored":346357605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574982,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345068,"kb_used_data":263908,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94026772,"statfs":{"total":96636764160,"available":96283414528,"internally_reserved":0,"allocated":270241792,"data_stored":270025761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":417136,"kb_used_data":317928,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93954704,"statfs":{"total":96636764160,"available":96209616896,"internally_reserved":0,"allocated":325558272,"data_stored":325332291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527448,"kb_used_data":397712,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":93844392,"statfs":{"total":96636764160,"available":96096657408,"internally_reserved":0,"allocated":407257088,"data_stored":407036489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132839879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274140,"kb_used_data":198548,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94097700,"statfs":{"total":96636764160,"available":96356044800,"internally_reserved":0,"allocated":203313152,"data_stored":203100073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":490184,"kb_used_data":378496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93881656,"statfs":{"total":96636764160,"available":96134815744,"internally_reserved":0,"allocated":387579904,"data_stored":387359847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353376,"kb_used_data":259736,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94018464,"statfs":{"total":96636764160,"available":96274907136,"internally_reserved":0,"allocated":265969664,"data_stored":265742437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67117056,"data_stored":67109024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50917376,"data_stored":50908802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":65880064,"data_stored":65866108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67108954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":74264576,"data_stored":74255262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:08:56.002 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:56.003 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T17:58:16.502090+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=16, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:56.004 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-26T17:58:12.469172+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=17, tm_min=58, tm_sec=12, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=18, tm_min=8, tm_sec=30, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T18:08:56.004 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T18:09:15.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:15.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:16.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T18:09:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.118+0000 7f7def1c9640 1 Processor -- start 2024-04-26T18:09:16.118 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.118+0000 7f7def1c9640 1 -- start start 2024-04-26T18:09:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7def1c9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7def1c9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7def1c9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de815a8b0 con 0x7f7de8071480 2024-04-26T18:09:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7def1c9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7de8070180 con 0x7f7de80ca4f0 2024-04-26T18:09:16.120 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7def1c9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7de8159d30 con 0x7f7de80ca8d0 2024-04-26T18:09:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7decf65640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7ddffff640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:37258/0 (socket says 172.21.15.12:37258) 2024-04-26T18:09:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7decf65640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:39444/0 (socket says 172.21.15.12:39444) 2024-04-26T18:09:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.119+0000 7f7ddffff640 1 -- 172.21.15.12:0/1721645403 learned_addr learned my addr 172.21.15.12:0/1721645403 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7ddffff640 1 -- 172.21.15.12:0/1721645403 >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 msgr2=0x7f7de80cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7ddffff640 1 --2- 172.21.15.12:0/1721645403 >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7ddffff640 1 -- 172.21.15.12:0/1721645403 >> v1:172.21.15.100:6789/0 conn(0x7f7de8071480 legacy=0x7f7de81534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7ddffff640 1 -- 172.21.15.12:0/1721645403 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de815a010 con 0x7f7de80ca8d0 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7decf65640 1 --2- 172.21.15.12:0/1721645403 >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:16.122 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.120+0000 7f7ddffff640 1 --2- 172.21.15.12:0/1721645403 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=567d26580acd7cc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7ddf7fe640 1 -- 172.21.15.12:0/1721645403 <== mon.2 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8037070 con 0x7f7de80ca8d0 2024-04-26T18:09:16.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7ddf7fe640 1 -- 172.21.15.12:0/1721645403 <== mon.2 v2:172.21.15.100:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd8032440 con 0x7f7de80ca8d0 2024-04-26T18:09:16.123 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7ddf7fe640 1 -- 172.21.15.12:0/1721645403 <== mon.2 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8032810 con 0x7f7de80ca8d0 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 -- 172.21.15.12:0/1721645403 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 msgr2=0x7f7de8070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1721645403 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009870 tx=0x7f7dd802a270 comp rx=0 tx=0).stop 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 -- 172.21.15.12:0/1721645403 shutdown_connections 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1721645403 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca8d0 0x7f7de8070610 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1721645403 >> v2:172.21.15.100:3300/0 conn(0x7f7de80ca4f0 0x7f7de80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.127 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 -- 172.21.15.12:0/1721645403 >> 172.21.15.12:0/1721645403 conn(0x7f7de8071ec0 msgr2=0x7f7de80722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 -- 172.21.15.12:0/1721645403 shutdown_connections 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.121+0000 7f7def1c9640 1 -- 172.21.15.12:0/1721645403 wait complete. 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.123+0000 7f7def1c9640 1 Processor -- start 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.123+0000 7f7def1c9640 1 -- start start 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.123+0000 7f7def1c9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.123+0000 7f7def1c9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca4f0 0x7f7de81545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.123+0000 7f7def1c9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80ca8d0 0x7f7de8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.128 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7def1c9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7de80cbbc0 con 0x7f7de8071480 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7def1c9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7de815a5d0 con 0x7f7de80ca8d0 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7def1c9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7de8159910 con 0x7f7de80ca4f0 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35974/0 (socket says 172.21.15.12:35974) 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 -- 172.21.15.12:0/1945149664 learned_addr learned my addr 172.21.15.12:0/1945149664 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7ddffff640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca4f0 0x7f7de81545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7ded766640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80ca8d0 0x7f7de8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.129 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 -- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca4f0 msgr2=0x7f7de81545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca4f0 0x7f7de81545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 -- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80ca8d0 msgr2=0x7f7de8154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80ca8d0 0x7f7de8154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 -- 172.21.15.12:0/1945149664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de814e800 con 0x7f7de8071480 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7decf65640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7de400ebe0 tx=0x7f7de400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4017070 con 0x7f7de8071480 2024-04-26T18:09:16.130 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de400cc30 con 0x7f7de8071480 2024-04-26T18:09:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de4013470 con 0x7f7de8071480 2024-04-26T18:09:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.124+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de81e6110 con 0x7f7de8071480 2024-04-26T18:09:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.125+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de81e66d0 con 0x7f7de8071480 2024-04-26T18:09:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.125+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de8076d20 con 0x7f7de8071480 2024-04-26T18:09:16.131 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.126+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7de401a070 con 0x7f7de8071480 2024-04-26T18:09:16.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.126+0000 7f7ddd7fa640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 0x7f7dd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.126+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f7de408be90 con 0x7f7de8071480 2024-04-26T18:09:16.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.127+0000 7f7ddffff640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 0x7f7dd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.132 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.127+0000 7f7ddffff640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 0x7f7dd406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8034000 tx=0x7f7dd802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.133 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.132+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7de4059830 con 0x7f7de8071480 2024-04-26T18:09:16.314 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.315+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 --> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7de80c5500 con 0x7f7dd406c8f0 2024-04-26T18:09:16.323 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.324+0000 7f7ddd7fa640 1 -- 172.21.15.12:0/1945149664 <== mgr.4105 v2:172.21.15.100:6832/1835507235 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+337350 (secure 0 0 0) 0x7f7de80c5500 con 0x7f7dd406c8f0 2024-04-26T18:09:16.327 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:09:16.329 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2024-04-26T18:09:16.330 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 msgr2=0x7f7dd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 0x7f7dd406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8034000 tx=0x7f7dd802e000 comp rx=0 tx=0).stop 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 msgr2=0x7f7de80b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7de400ebe0 tx=0x7f7de400c520 comp rx=0 tx=0).stop 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 shutdown_connections 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7de80ca8d0 0x7f7de8154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7dd406c8f0 0x7f7dd406edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7de80ca4f0 0x7f7de81545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.331 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 --2- 172.21.15.12:0/1945149664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7de8071480 0x7f7de80b3dd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 >> 172.21.15.12:0/1945149664 conn(0x7f7de8071ec0 msgr2=0x7f7de80cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 shutdown_connections 2024-04-26T18:09:16.332 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.327+0000 7f7def1c9640 1 -- 172.21.15.12:0/1945149664 wait complete. 2024-04-26T18:09:16.337 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-04-26T18:09:16.047536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1189056822,"num_objects":10790,"num_object_clones":0,"num_object_copies":42852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10790,"num_whiteouts":0,"num_read":1486,"num_read_kb":386998,"num_write":30440,"num_write_kb":1788652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":665880,"num_omap_keys":1113,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35951,"ondisk_log_size":35951,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3232296,"kb_used_data":2444328,"kb_used_omap":12,"kb_used_meta":787891,"kb_avail":751742424,"statfs":{"total":773094113280,"available":769784242176,"internally_reserved":0,"allocated":2502991872,"data_stored":2501231732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":806800944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":108663,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003502"},"pg_stats":[{"pgid":"2.1f","version":"36'132","reported_seq":192,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.389841+0000","last_change":"2024-04-26T18:08:34.389841+0000","last_active":"2024-04-26T18:08:34.389841+0000","last_peered":"2024-04-26T18:08:34.389841+0000","last_clean":"2024-04-26T18:08:34.389841+0000","last_became_active":"2024-04-26T17:58:12.496917+0000","last_became_peered":"2024-04-26T17:58:12.496917+0000","last_unstale":"2024-04-26T18:08:34.389841+0000","last_undegraded":"2024-04-26T18:08:34.389841+0000","last_fullsized":"2024-04-26T18:08:34.389841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'132","last_scrub_stamp":"2024-04-26T18:08:34.389684+0000","last_deep_scrub":"36'132","last_deep_scrub_stamp":"2024-04-26T18:08:34.389684+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.389684+0000","objects_scrubbed":10,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:21.946000+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":8322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":70339,"num_omap_keys":117,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"36'92","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.530201+0000","last_change":"2024-04-26T18:08:43.530228+0000","last_active":"2024-04-26T18:08:43.530201+0000","last_peered":"2024-04-26T18:08:43.530201+0000","last_clean":"2024-04-26T18:08:43.530201+0000","last_became_active":"2024-04-26T17:58:13.495962+0000","last_became_peered":"2024-04-26T17:58:13.495962+0000","last_unstale":"2024-04-26T18:08:43.530201+0000","last_undegraded":"2024-04-26T18:08:43.530201+0000","last_fullsized":"2024-04-26T18:08:43.530201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:43.530114+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:43.530114+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.530114+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:49.267100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.138085596,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'687","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:51.632835+0000","last_change":"2024-04-26T18:08:51.632873+0000","last_active":"2024-04-26T18:08:51.632835+0000","last_peered":"2024-04-26T18:08:51.632835+0000","last_clean":"2024-04-26T18:08:51.632835+0000","last_became_active":"2024-04-26T17:58:17.708839+0000","last_became_peered":"2024-04-26T17:58:17.708839+0000","last_unstale":"2024-04-26T18:08:51.632835+0000","last_undegraded":"2024-04-26T18:08:51.632835+0000","last_fullsized":"2024-04-26T18:08:51.632835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'687","last_scrub_stamp":"2024-04-26T18:08:51.632751+0000","last_deep_scrub":"36'687","last_deep_scrub_stamp":"2024-04-26T18:08:51.632751+0000","last_clean_scrub_stamp":"2024-04-26T18:08:51.632751+0000","objects_scrubbed":319,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:43:03.654507+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0.149551991,"stat_sum":{"num_bytes":25650761,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":684,"num_write_kb":49909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"36'1627","reported_seq":1687,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.521408+0000","last_change":"2024-04-26T18:08:40.521442+0000","last_active":"2024-04-26T18:08:40.521408+0000","last_peered":"2024-04-26T18:08:40.521408+0000","last_clean":"2024-04-26T18:08:40.521408+0000","last_became_active":"2024-04-26T17:58:12.495864+0000","last_became_peered":"2024-04-26T17:58:12.495864+0000","last_unstale":"2024-04-26T18:08:40.521408+0000","last_undegraded":"2024-04-26T18:08:40.521408+0000","last_fullsized":"2024-04-26T18:08:40.521408+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1627","last_scrub_stamp":"2024-04-26T18:08:40.521335+0000","last_deep_scrub":"36'1627","last_deep_scrub_stamp":"2024-04-26T18:08:40.521335+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.521335+0000","objects_scrubbed":5,"log_size":1627,"log_dups_size":0,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:37.360676+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1622,"num_write_kb":13686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21245,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"36'87","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.352891+0000","last_change":"2024-04-26T18:08:40.352891+0000","last_active":"2024-04-26T18:08:40.352891+0000","last_peered":"2024-04-26T18:08:40.352891+0000","last_clean":"2024-04-26T18:08:40.352891+0000","last_became_active":"2024-04-26T17:58:13.495710+0000","last_became_peered":"2024-04-26T17:58:13.495710+0000","last_unstale":"2024-04-26T18:08:40.352891+0000","last_undegraded":"2024-04-26T18:08:40.352891+0000","last_fullsized":"2024-04-26T18:08:40.352891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-04-26T18:08:40.352791+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-04-26T18:08:40.352791+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.352791+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:38:04.244222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.129569973,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"36'690","reported_seq":2812,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.224190+0000","last_change":"2024-04-26T18:08:44.224221+0000","last_active":"2024-04-26T18:08:44.224190+0000","last_peered":"2024-04-26T18:08:44.224190+0000","last_clean":"2024-04-26T18:08:44.224190+0000","last_became_active":"2024-04-26T17:58:17.538498+0000","last_became_peered":"2024-04-26T17:58:17.538498+0000","last_unstale":"2024-04-26T18:08:44.224190+0000","last_undegraded":"2024-04-26T18:08:44.224190+0000","last_fullsized":"2024-04-26T18:08:44.224190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'690","last_scrub_stamp":"2024-04-26T18:08:44.224102+0000","last_deep_scrub":"36'690","last_deep_scrub_stamp":"2024-04-26T18:08:44.224102+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.224102+0000","objects_scrubbed":353,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:50:35.555154+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.12219766899999999,"stat_sum":{"num_bytes":34601971,"num_objects":353,"num_object_clones":0,"num_object_copies":1412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":353,"num_whiteouts":0,"num_read":36,"num_read_kb":12321,"num_write":692,"num_write_kb":42239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"36'727","reported_seq":786,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.538218+0000","last_change":"2024-04-26T18:08:40.538254+0000","last_active":"2024-04-26T18:08:40.538218+0000","last_peered":"2024-04-26T18:08:40.538218+0000","last_clean":"2024-04-26T18:08:40.538218+0000","last_became_active":"2024-04-26T17:58:12.498117+0000","last_became_peered":"2024-04-26T17:58:12.498117+0000","last_unstale":"2024-04-26T18:08:40.538218+0000","last_undegraded":"2024-04-26T18:08:40.538218+0000","last_fullsized":"2024-04-26T18:08:40.538218+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'727","last_scrub_stamp":"2024-04-26T18:08:40.538152+0000","last_deep_scrub":"36'727","last_deep_scrub_stamp":"2024-04-26T18:08:40.538152+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.538152+0000","objects_scrubbed":7,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:23:01.782633+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":719,"num_write_kb":16932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20619,"num_omap_keys":35,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"36'91","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.369207+0000","last_change":"2024-04-26T18:08:44.369227+0000","last_active":"2024-04-26T18:08:44.369207+0000","last_peered":"2024-04-26T18:08:44.369207+0000","last_clean":"2024-04-26T18:08:44.369207+0000","last_became_active":"2024-04-26T17:58:13.500368+0000","last_became_peered":"2024-04-26T17:58:13.500368+0000","last_unstale":"2024-04-26T18:08:44.369207+0000","last_undegraded":"2024-04-26T18:08:44.369207+0000","last_fullsized":"2024-04-26T18:08:44.369207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:44.369125+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:44.369125+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.369125+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:26.703934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101162817,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'688","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.231767+0000","last_change":"2024-04-26T18:08:43.231802+0000","last_active":"2024-04-26T18:08:43.231767+0000","last_peered":"2024-04-26T18:08:43.231767+0000","last_clean":"2024-04-26T18:08:43.231767+0000","last_became_active":"2024-04-26T17:58:17.538469+0000","last_became_peered":"2024-04-26T17:58:17.538469+0000","last_unstale":"2024-04-26T18:08:43.231767+0000","last_undegraded":"2024-04-26T18:08:43.231767+0000","last_fullsized":"2024-04-26T18:08:43.231767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'688","last_scrub_stamp":"2024-04-26T18:08:43.231685+0000","last_deep_scrub":"36'688","last_deep_scrub_stamp":"2024-04-26T18:08:43.231685+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.231685+0000","objects_scrubbed":316,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:11.124607+0000","scrub_duration":115,"objects_trimmed":0,"snaptrim_duration":0.124223892,"stat_sum":{"num_bytes":21086140,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":688,"num_write_kb":41381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"36'168","reported_seq":227,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.484492+0000","last_change":"2024-04-26T18:08:39.484546+0000","last_active":"2024-04-26T18:08:39.484492+0000","last_peered":"2024-04-26T18:08:39.484492+0000","last_clean":"2024-04-26T18:08:39.484492+0000","last_became_active":"2024-04-26T17:58:12.497593+0000","last_became_peered":"2024-04-26T17:58:12.497593+0000","last_unstale":"2024-04-26T18:08:39.484492+0000","last_undegraded":"2024-04-26T18:08:39.484492+0000","last_fullsized":"2024-04-26T18:08:39.484492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'168","last_scrub_stamp":"2024-04-26T18:08:39.484398+0000","last_deep_scrub":"36'168","last_deep_scrub_stamp":"2024-04-26T18:08:39.484398+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.484398+0000","objects_scrubbed":5,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:42:03.756852+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":4229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29136,"num_omap_keys":48,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"36'90","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.388855+0000","last_change":"2024-04-26T18:08:45.388875+0000","last_active":"2024-04-26T18:08:45.388855+0000","last_peered":"2024-04-26T18:08:45.388855+0000","last_clean":"2024-04-26T18:08:45.388855+0000","last_became_active":"2024-04-26T17:58:13.499824+0000","last_became_peered":"2024-04-26T17:58:13.499824+0000","last_unstale":"2024-04-26T18:08:45.388855+0000","last_undegraded":"2024-04-26T18:08:45.388855+0000","last_fullsized":"2024-04-26T18:08:45.388855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:45.388786+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:45.388786+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.388786+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:42:44.265542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10492303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'676","reported_seq":2801,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.231511+0000","last_change":"2024-04-26T18:08:45.231564+0000","last_active":"2024-04-26T18:08:45.231511+0000","last_peered":"2024-04-26T18:08:45.231511+0000","last_clean":"2024-04-26T18:08:45.231511+0000","last_became_active":"2024-04-26T17:58:17.539342+0000","last_became_peered":"2024-04-26T17:58:17.539342+0000","last_unstale":"2024-04-26T18:08:45.231511+0000","last_undegraded":"2024-04-26T18:08:45.231511+0000","last_fullsized":"2024-04-26T18:08:45.231511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'676","last_scrub_stamp":"2024-04-26T18:08:45.231396+0000","last_deep_scrub":"36'676","last_deep_scrub_stamp":"2024-04-26T18:08:45.231396+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.231396+0000","objects_scrubbed":338,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:00:06.309548+0000","scrub_duration":136,"objects_trimmed":0,"snaptrim_duration":0.123482601,"stat_sum":{"num_bytes":52916603,"num_objects":338,"num_object_clones":0,"num_object_copies":1352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":338,"num_whiteouts":0,"num_read":40,"num_read_kb":16419,"num_write":676,"num_write_kb":70178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"36'88","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.216711+0000","last_change":"2024-04-26T18:08:42.216711+0000","last_active":"2024-04-26T18:08:42.216711+0000","last_peered":"2024-04-26T18:08:42.216711+0000","last_clean":"2024-04-26T18:08:42.216711+0000","last_became_active":"2024-04-26T17:58:13.490567+0000","last_became_peered":"2024-04-26T17:58:13.490567+0000","last_unstale":"2024-04-26T18:08:42.216711+0000","last_undegraded":"2024-04-26T18:08:42.216711+0000","last_fullsized":"2024-04-26T18:08:42.216711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:42.216625+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:42.216625+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.216625+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:02:57.648719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10103103500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"36'231","reported_seq":290,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.497853+0000","last_change":"2024-04-26T18:08:38.497893+0000","last_active":"2024-04-26T18:08:38.497853+0000","last_peered":"2024-04-26T18:08:38.497853+0000","last_clean":"2024-04-26T18:08:38.497853+0000","last_became_active":"2024-04-26T17:58:12.495640+0000","last_became_peered":"2024-04-26T17:58:12.495640+0000","last_unstale":"2024-04-26T18:08:38.497853+0000","last_undegraded":"2024-04-26T18:08:38.497853+0000","last_fullsized":"2024-04-26T18:08:38.497853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'231","last_scrub_stamp":"2024-04-26T18:08:38.497760+0000","last_deep_scrub":"36'231","last_deep_scrub_stamp":"2024-04-26T18:08:38.497760+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.497760+0000","objects_scrubbed":6,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:01:55.918548+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":222,"num_write_kb":12415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24887,"num_omap_keys":41,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'653","reported_seq":2776,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.218533+0000","last_change":"2024-04-26T18:08:46.218577+0000","last_active":"2024-04-26T18:08:46.218533+0000","last_peered":"2024-04-26T18:08:46.218533+0000","last_clean":"2024-04-26T18:08:46.218533+0000","last_became_active":"2024-04-26T17:58:17.539257+0000","last_became_peered":"2024-04-26T17:58:17.539257+0000","last_unstale":"2024-04-26T18:08:46.218533+0000","last_undegraded":"2024-04-26T18:08:46.218533+0000","last_fullsized":"2024-04-26T18:08:46.218533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'653","last_scrub_stamp":"2024-04-26T18:08:46.218439+0000","last_deep_scrub":"36'653","last_deep_scrub_stamp":"2024-04-26T18:08:46.218439+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.218439+0000","objects_scrubbed":314,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:05:41.353180+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.12347570300000001,"stat_sum":{"num_bytes":25286532,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":39,"num_read_kb":16418,"num_write":652,"num_write_kb":49602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.503504+0000","last_change":"2024-04-26T18:08:42.503528+0000","last_active":"2024-04-26T18:08:42.503504+0000","last_peered":"2024-04-26T18:08:42.503504+0000","last_clean":"2024-04-26T18:08:42.503504+0000","last_became_active":"2024-04-26T17:58:13.495324+0000","last_became_peered":"2024-04-26T17:58:13.495324+0000","last_unstale":"2024-04-26T18:08:42.503504+0000","last_undegraded":"2024-04-26T18:08:42.503504+0000","last_fullsized":"2024-04-26T18:08:42.503504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:42.503421+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:42.503421+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.503421+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:33:39.788240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140787518,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"36'842","reported_seq":902,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.953253+0000","last_change":"2024-04-26T18:08:38.953253+0000","last_active":"2024-04-26T18:08:38.953253+0000","last_peered":"2024-04-26T18:08:38.953253+0000","last_clean":"2024-04-26T18:08:38.953253+0000","last_became_active":"2024-04-26T17:58:12.500563+0000","last_became_peered":"2024-04-26T17:58:12.500563+0000","last_unstale":"2024-04-26T18:08:38.953253+0000","last_undegraded":"2024-04-26T18:08:38.953253+0000","last_fullsized":"2024-04-26T18:08:38.953253+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'842","last_scrub_stamp":"2024-04-26T18:08:38.953137+0000","last_deep_scrub":"36'842","last_deep_scrub_stamp":"2024-04-26T18:08:38.953137+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.953137+0000","objects_scrubbed":5,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:06:41.105328+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":838,"num_write_kb":12887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17603,"num_omap_keys":29,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"36'695","reported_seq":2815,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.191237+0000","last_change":"2024-04-26T18:08:41.191289+0000","last_active":"2024-04-26T18:08:41.191237+0000","last_peered":"2024-04-26T18:08:41.191237+0000","last_clean":"2024-04-26T18:08:41.191237+0000","last_became_active":"2024-04-26T17:58:17.536629+0000","last_became_peered":"2024-04-26T17:58:17.536629+0000","last_unstale":"2024-04-26T18:08:41.191237+0000","last_undegraded":"2024-04-26T18:08:41.191237+0000","last_fullsized":"2024-04-26T18:08:41.191237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'695","last_scrub_stamp":"2024-04-26T18:08:41.191145+0000","last_deep_scrub":"36'695","last_deep_scrub_stamp":"2024-04-26T18:08:41.191145+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.191145+0000","objects_scrubbed":328,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:00.278381+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0.12374347199999999,"stat_sum":{"num_bytes":20883611,"num_objects":328,"num_object_clones":0,"num_object_copies":1312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":328,"num_whiteouts":0,"num_read":35,"num_read_kb":4130,"num_write":692,"num_write_kb":37139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'94","reported_seq":2173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.494798+0000","last_change":"2024-04-26T18:08:35.494798+0000","last_active":"2024-04-26T18:08:35.494798+0000","last_peered":"2024-04-26T18:08:35.494798+0000","last_clean":"2024-04-26T18:08:35.494798+0000","last_became_active":"2024-04-26T17:58:13.498705+0000","last_became_peered":"2024-04-26T17:58:13.498705+0000","last_unstale":"2024-04-26T18:08:35.494798+0000","last_undegraded":"2024-04-26T18:08:35.494798+0000","last_fullsized":"2024-04-26T18:08:35.494798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'94","last_scrub_stamp":"2024-04-26T18:08:35.494706+0000","last_deep_scrub":"36'94","last_deep_scrub_stamp":"2024-04-26T18:08:35.494706+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.494706+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:27:30.112600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.140637862,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'73","reported_seq":133,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.893127+0000","last_change":"2024-04-26T18:08:37.893127+0000","last_active":"2024-04-26T18:08:37.893127+0000","last_peered":"2024-04-26T18:08:37.893127+0000","last_clean":"2024-04-26T18:08:37.893127+0000","last_became_active":"2024-04-26T17:58:12.500337+0000","last_became_peered":"2024-04-26T17:58:12.500337+0000","last_unstale":"2024-04-26T18:08:37.893127+0000","last_undegraded":"2024-04-26T18:08:37.893127+0000","last_fullsized":"2024-04-26T18:08:37.893127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'73","last_scrub_stamp":"2024-04-26T18:08:37.893011+0000","last_deep_scrub":"36'73","last_deep_scrub_stamp":"2024-04-26T18:08:37.893011+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.893011+0000","objects_scrubbed":6,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:57:34.704512+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50246,"num_omap_keys":84,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"36'688","reported_seq":2816,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.169263+0000","last_change":"2024-04-26T18:08:49.169314+0000","last_active":"2024-04-26T18:08:49.169263+0000","last_peered":"2024-04-26T18:08:49.169263+0000","last_clean":"2024-04-26T18:08:49.169263+0000","last_became_active":"2024-04-26T17:58:17.705073+0000","last_became_peered":"2024-04-26T17:58:17.705073+0000","last_unstale":"2024-04-26T18:08:49.169263+0000","last_undegraded":"2024-04-26T18:08:49.169263+0000","last_fullsized":"2024-04-26T18:08:49.169263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'688","last_scrub_stamp":"2024-04-26T18:08:49.169183+0000","last_deep_scrub":"36'688","last_deep_scrub_stamp":"2024-04-26T18:08:49.169183+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.169183+0000","objects_scrubbed":349,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:17:13.808961+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.062597114999999995,"stat_sum":{"num_bytes":37355037,"num_objects":349,"num_object_clones":0,"num_object_copies":1396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":349,"num_whiteouts":0,"num_read":43,"num_read_kb":12328,"num_write":685,"num_write_kb":57318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"36'93","reported_seq":2172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.050694+0000","last_change":"2024-04-26T18:08:36.050694+0000","last_active":"2024-04-26T18:08:36.050694+0000","last_peered":"2024-04-26T18:08:36.050694+0000","last_clean":"2024-04-26T18:08:36.050694+0000","last_became_active":"2024-04-26T17:58:13.491467+0000","last_became_peered":"2024-04-26T17:58:13.491467+0000","last_unstale":"2024-04-26T18:08:36.050694+0000","last_undegraded":"2024-04-26T18:08:36.050694+0000","last_fullsized":"2024-04-26T18:08:36.050694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:36.050537+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:36.050537+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.050537+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:01:35.363772+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.121954573,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'9","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.564667+0000","last_change":"2024-04-26T18:08:42.564667+0000","last_active":"2024-04-26T18:08:42.564667+0000","last_peered":"2024-04-26T18:08:42.564667+0000","last_clean":"2024-04-26T18:08:42.564667+0000","last_became_active":"2024-04-26T17:58:12.499008+0000","last_became_peered":"2024-04-26T17:58:12.499008+0000","last_unstale":"2024-04-26T18:08:42.564667+0000","last_undegraded":"2024-04-26T18:08:42.564667+0000","last_fullsized":"2024-04-26T18:08:42.564667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-04-26T18:08:42.564578+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-04-26T18:08:42.564578+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.564578+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:25:31.462490+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19056,"num_omap_keys":32,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'594","reported_seq":2719,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.146398+0000","last_change":"2024-04-26T18:08:40.146460+0000","last_active":"2024-04-26T18:08:40.146398+0000","last_peered":"2024-04-26T18:08:40.146398+0000","last_clean":"2024-04-26T18:08:40.146398+0000","last_became_active":"2024-04-26T17:58:17.530698+0000","last_became_peered":"2024-04-26T17:58:17.530698+0000","last_unstale":"2024-04-26T18:08:40.146398+0000","last_undegraded":"2024-04-26T18:08:40.146398+0000","last_fullsized":"2024-04-26T18:08:40.146398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'594","last_scrub_stamp":"2024-04-26T18:08:40.146285+0000","last_deep_scrub":"36'594","last_deep_scrub_stamp":"2024-04-26T18:08:40.146285+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.146285+0000","objects_scrubbed":311,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:57:53.835655+0000","scrub_duration":109,"objects_trimmed":0,"snaptrim_duration":0.123861913,"stat_sum":{"num_bytes":20363830,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":41,"num_read_kb":16420,"num_write":594,"num_write_kb":36549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"36'93","reported_seq":2172,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.343792+0000","last_change":"2024-04-26T18:08:42.343792+0000","last_active":"2024-04-26T18:08:42.343792+0000","last_peered":"2024-04-26T18:08:42.343792+0000","last_clean":"2024-04-26T18:08:42.343792+0000","last_became_active":"2024-04-26T17:58:13.499497+0000","last_became_peered":"2024-04-26T17:58:13.499497+0000","last_unstale":"2024-04-26T18:08:42.343792+0000","last_undegraded":"2024-04-26T18:08:42.343792+0000","last_fullsized":"2024-04-26T18:08:42.343792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:42.343662+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:42.343662+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.343662+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:38:47.971249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.132938523,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"36'194","reported_seq":254,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.079750+0000","last_change":"2024-04-26T18:08:36.079750+0000","last_active":"2024-04-26T18:08:36.079750+0000","last_peered":"2024-04-26T18:08:36.079750+0000","last_clean":"2024-04-26T18:08:36.079750+0000","last_became_active":"2024-04-26T17:58:12.494643+0000","last_became_peered":"2024-04-26T17:58:12.494643+0000","last_unstale":"2024-04-26T18:08:36.079750+0000","last_undegraded":"2024-04-26T18:08:36.079750+0000","last_fullsized":"2024-04-26T18:08:36.079750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'194","last_scrub_stamp":"2024-04-26T18:08:36.079615+0000","last_deep_scrub":"36'194","last_deep_scrub_stamp":"2024-04-26T18:08:36.079615+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.079615+0000","objects_scrubbed":2,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:43:16.335076+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":4207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"36'707","reported_seq":2822,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.264587+0000","last_change":"2024-04-26T18:08:47.264666+0000","last_active":"2024-04-26T18:08:47.264587+0000","last_peered":"2024-04-26T18:08:47.264587+0000","last_clean":"2024-04-26T18:08:47.264587+0000","last_became_active":"2024-04-26T17:58:17.708173+0000","last_became_peered":"2024-04-26T17:58:17.708173+0000","last_unstale":"2024-04-26T18:08:47.264587+0000","last_undegraded":"2024-04-26T18:08:47.264587+0000","last_fullsized":"2024-04-26T18:08:47.264587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'707","last_scrub_stamp":"2024-04-26T18:08:47.264498+0000","last_deep_scrub":"36'707","last_deep_scrub_stamp":"2024-04-26T18:08:47.264498+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.264498+0000","objects_scrubbed":346,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:11:51.300682+0000","scrub_duration":138,"objects_trimmed":0,"snaptrim_duration":0.12225765099999999,"stat_sum":{"num_bytes":19638375,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":29,"num_read_kb":399,"num_write":705,"num_write_kb":44121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"36'88","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.084509+0000","last_change":"2024-04-26T18:08:50.084534+0000","last_active":"2024-04-26T18:08:50.084509+0000","last_peered":"2024-04-26T18:08:50.084509+0000","last_clean":"2024-04-26T18:08:50.084509+0000","last_became_active":"2024-04-26T17:58:55.723214+0000","last_became_peered":"2024-04-26T17:58:55.723214+0000","last_unstale":"2024-04-26T18:08:50.084509+0000","last_undegraded":"2024-04-26T18:08:50.084509+0000","last_fullsized":"2024-04-26T18:08:50.084509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:50.084440+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:50.084440+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.084440+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:05:00.429009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063052859000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"36'262","reported_seq":322,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.876721+0000","last_change":"2024-04-26T18:08:36.876721+0000","last_active":"2024-04-26T18:08:36.876721+0000","last_peered":"2024-04-26T18:08:36.876721+0000","last_clean":"2024-04-26T18:08:36.876721+0000","last_became_active":"2024-04-26T17:58:12.499962+0000","last_became_peered":"2024-04-26T17:58:12.499962+0000","last_unstale":"2024-04-26T18:08:36.876721+0000","last_undegraded":"2024-04-26T18:08:36.876721+0000","last_fullsized":"2024-04-26T18:08:36.876721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'262","last_scrub_stamp":"2024-04-26T18:08:36.876608+0000","last_deep_scrub":"36'262","last_deep_scrub_stamp":"2024-04-26T18:08:36.876608+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.876608+0000","objects_scrubbed":3,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:20:14.110826+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":2116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9666,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"36'710","reported_seq":2852,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:53.646238+0000","last_change":"2024-04-26T18:08:53.646271+0000","last_active":"2024-04-26T18:08:53.646238+0000","last_peered":"2024-04-26T18:08:53.646238+0000","last_clean":"2024-04-26T18:08:53.646238+0000","last_became_active":"2024-04-26T17:58:55.723378+0000","last_became_peered":"2024-04-26T17:58:55.723378+0000","last_unstale":"2024-04-26T18:08:53.646238+0000","last_undegraded":"2024-04-26T18:08:53.646238+0000","last_fullsized":"2024-04-26T18:08:53.646238+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'710","last_scrub_stamp":"2024-04-26T18:08:53.646146+0000","last_deep_scrub":"36'710","last_deep_scrub_stamp":"2024-04-26T18:08:53.646146+0000","last_clean_scrub_stamp":"2024-04-26T18:08:53.646146+0000","objects_scrubbed":357,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:49:50.737502+0000","scrub_duration":135,"objects_trimmed":0,"snaptrim_duration":0.14398412799999999,"stat_sum":{"num_bytes":28506555,"num_objects":357,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":48,"num_read_kb":8236,"num_write":709,"num_write_kb":48690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.894969+0000","last_change":"2024-04-26T18:08:41.894969+0000","last_active":"2024-04-26T18:08:41.894969+0000","last_peered":"2024-04-26T18:08:41.894969+0000","last_clean":"2024-04-26T18:08:41.894969+0000","last_became_active":"2024-04-26T17:58:13.498114+0000","last_became_peered":"2024-04-26T17:58:13.498114+0000","last_unstale":"2024-04-26T18:08:41.894969+0000","last_undegraded":"2024-04-26T18:08:41.894969+0000","last_fullsized":"2024-04-26T18:08:41.894969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:41.894850+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:41.894850+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.894850+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:41:00.849930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061479828,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"36'147","reported_seq":207,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.560326+0000","last_change":"2024-04-26T18:08:41.560372+0000","last_active":"2024-04-26T18:08:41.560326+0000","last_peered":"2024-04-26T18:08:41.560326+0000","last_clean":"2024-04-26T18:08:41.560326+0000","last_became_active":"2024-04-26T17:58:12.498792+0000","last_became_peered":"2024-04-26T17:58:12.498792+0000","last_unstale":"2024-04-26T18:08:41.560326+0000","last_undegraded":"2024-04-26T18:08:41.560326+0000","last_fullsized":"2024-04-26T18:08:41.560326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'147","last_scrub_stamp":"2024-04-26T18:08:41.560237+0000","last_deep_scrub":"36'147","last_deep_scrub_stamp":"2024-04-26T18:08:41.560237+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.560237+0000","objects_scrubbed":3,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:51:52.907427+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5463,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"36'686","reported_seq":2808,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.547050+0000","last_change":"2024-04-26T18:08:46.547086+0000","last_active":"2024-04-26T18:08:46.547050+0000","last_peered":"2024-04-26T18:08:46.547050+0000","last_clean":"2024-04-26T18:08:46.547050+0000","last_became_active":"2024-04-26T17:58:17.705066+0000","last_became_peered":"2024-04-26T17:58:17.705066+0000","last_unstale":"2024-04-26T18:08:46.547050+0000","last_undegraded":"2024-04-26T18:08:46.547050+0000","last_fullsized":"2024-04-26T18:08:46.547050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'686","last_scrub_stamp":"2024-04-26T18:08:46.546969+0000","last_deep_scrub":"36'686","last_deep_scrub_stamp":"2024-04-26T18:08:46.546969+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.546969+0000","objects_scrubbed":320,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:46:55.026094+0000","scrub_duration":104,"objects_trimmed":0,"snaptrim_duration":0.121139551,"stat_sum":{"num_bytes":22514604,"num_objects":320,"num_object_clones":0,"num_object_copies":1280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":320,"num_whiteouts":0,"num_read":37,"num_read_kb":12024,"num_write":686,"num_write_kb":30533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"36'84","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.375411+0000","last_change":"2024-04-26T18:08:42.375433+0000","last_active":"2024-04-26T18:08:42.375411+0000","last_peered":"2024-04-26T18:08:42.375411+0000","last_clean":"2024-04-26T18:08:42.375411+0000","last_became_active":"2024-04-26T17:58:13.497711+0000","last_became_peered":"2024-04-26T17:58:13.497711+0000","last_unstale":"2024-04-26T18:08:42.375411+0000","last_undegraded":"2024-04-26T18:08:42.375411+0000","last_fullsized":"2024-04-26T18:08:42.375411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-04-26T18:08:42.375344+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-04-26T18:08:42.375344+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.375344+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:04:34.776468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.105400089,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"36'134","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.871325+0000","last_change":"2024-04-26T18:08:35.871325+0000","last_active":"2024-04-26T18:08:35.871325+0000","last_peered":"2024-04-26T18:08:35.871325+0000","last_clean":"2024-04-26T18:08:35.871325+0000","last_became_active":"2024-04-26T17:58:12.498034+0000","last_became_peered":"2024-04-26T17:58:12.498034+0000","last_unstale":"2024-04-26T18:08:35.871325+0000","last_undegraded":"2024-04-26T18:08:35.871325+0000","last_fullsized":"2024-04-26T18:08:35.871325+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'134","last_scrub_stamp":"2024-04-26T18:08:35.871188+0000","last_deep_scrub":"36'134","last_deep_scrub_stamp":"2024-04-26T18:08:35.871188+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.871188+0000","objects_scrubbed":5,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:29:21.498324+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":4244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20316,"num_omap_keys":34,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'699","reported_seq":2824,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.111216+0000","last_change":"2024-04-26T18:08:46.111266+0000","last_active":"2024-04-26T18:08:46.111216+0000","last_peered":"2024-04-26T18:08:46.111216+0000","last_clean":"2024-04-26T18:08:46.111216+0000","last_became_active":"2024-04-26T17:58:17.538829+0000","last_became_peered":"2024-04-26T17:58:17.538829+0000","last_unstale":"2024-04-26T18:08:46.111216+0000","last_undegraded":"2024-04-26T18:08:46.111216+0000","last_fullsized":"2024-04-26T18:08:46.111216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'699","last_scrub_stamp":"2024-04-26T18:08:46.111099+0000","last_deep_scrub":"36'699","last_deep_scrub_stamp":"2024-04-26T18:08:46.111099+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.111099+0000","objects_scrubbed":331,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:25:34.225964+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0.060525726000000002,"stat_sum":{"num_bytes":38594367,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":39,"num_read_kb":10866,"num_write":699,"num_write_kb":70821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"36'96","reported_seq":2175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.075281+0000","last_change":"2024-04-26T18:08:35.075281+0000","last_active":"2024-04-26T18:08:35.075281+0000","last_peered":"2024-04-26T18:08:35.075281+0000","last_clean":"2024-04-26T18:08:35.075281+0000","last_became_active":"2024-04-26T17:58:13.491517+0000","last_became_peered":"2024-04-26T17:58:13.491517+0000","last_unstale":"2024-04-26T18:08:35.075281+0000","last_undegraded":"2024-04-26T18:08:35.075281+0000","last_fullsized":"2024-04-26T18:08:35.075281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-04-26T18:08:35.075168+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-04-26T18:08:35.075168+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.075168+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:52:33.449863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.11918363899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'13","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.300201+0000","last_change":"2024-04-26T18:08:39.300257+0000","last_active":"2024-04-26T18:08:39.300201+0000","last_peered":"2024-04-26T18:08:39.300201+0000","last_clean":"2024-04-26T18:08:39.300201+0000","last_became_active":"2024-04-26T17:58:12.498740+0000","last_became_peered":"2024-04-26T17:58:12.498740+0000","last_unstale":"2024-04-26T18:08:39.300201+0000","last_undegraded":"2024-04-26T18:08:39.300201+0000","last_fullsized":"2024-04-26T18:08:39.300201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'13","last_scrub_stamp":"2024-04-26T18:08:39.300102+0000","last_deep_scrub":"36'13","last_deep_scrub_stamp":"2024-04-26T18:08:39.300102+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.300102+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:26:25.062601+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19912,"num_omap_keys":34,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"36'645","reported_seq":2761,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.066978+0000","last_change":"2024-04-26T18:08:45.067007+0000","last_active":"2024-04-26T18:08:45.066978+0000","last_peered":"2024-04-26T18:08:45.066978+0000","last_clean":"2024-04-26T18:08:45.066978+0000","last_became_active":"2024-04-26T17:58:17.533704+0000","last_became_peered":"2024-04-26T17:58:17.533704+0000","last_unstale":"2024-04-26T18:08:45.066978+0000","last_undegraded":"2024-04-26T18:08:45.066978+0000","last_fullsized":"2024-04-26T18:08:45.066978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'645","last_scrub_stamp":"2024-04-26T18:08:45.066893+0000","last_deep_scrub":"36'645","last_deep_scrub_stamp":"2024-04-26T18:08:45.066893+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.066893+0000","objects_scrubbed":329,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:14:56.222363+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.062199458999999999,"stat_sum":{"num_bytes":24369124,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":30,"num_read_kb":11492,"num_write":645,"num_write_kb":31513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"36'83","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.928529+0000","last_change":"2024-04-26T18:08:40.928567+0000","last_active":"2024-04-26T18:08:40.928529+0000","last_peered":"2024-04-26T18:08:40.928529+0000","last_clean":"2024-04-26T18:08:40.928529+0000","last_became_active":"2024-04-26T17:58:13.496214+0000","last_became_peered":"2024-04-26T17:58:13.496214+0000","last_unstale":"2024-04-26T18:08:40.928529+0000","last_undegraded":"2024-04-26T18:08:40.928529+0000","last_fullsized":"2024-04-26T18:08:40.928529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:40.928427+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:40.928427+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.928427+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:25:17.409370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.059304596000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'128","reported_seq":308,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.541649+0000","last_change":"2024-04-26T18:08:33.541649+0000","last_active":"2024-04-26T18:08:33.541649+0000","last_peered":"2024-04-26T18:08:33.541649+0000","last_clean":"2024-04-26T18:08:33.541649+0000","last_became_active":"2024-04-26T17:58:12.494125+0000","last_became_peered":"2024-04-26T17:58:12.494125+0000","last_unstale":"2024-04-26T18:08:33.541649+0000","last_undegraded":"2024-04-26T18:08:33.541649+0000","last_fullsized":"2024-04-26T18:08:33.541649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'128","last_scrub_stamp":"2024-04-26T18:08:33.541495+0000","last_deep_scrub":"36'128","last_deep_scrub_stamp":"2024-04-26T18:08:33.541495+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.541495+0000","objects_scrubbed":4,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:37:20.308421+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576482,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":126,"num_write_kb":680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30865,"num_omap_keys":51,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"36'644","reported_seq":2766,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.145142+0000","last_change":"2024-04-26T18:08:47.145142+0000","last_active":"2024-04-26T18:08:47.145142+0000","last_peered":"2024-04-26T18:08:47.145142+0000","last_clean":"2024-04-26T18:08:47.145142+0000","last_became_active":"2024-04-26T17:58:17.539147+0000","last_became_peered":"2024-04-26T17:58:17.539147+0000","last_unstale":"2024-04-26T18:08:47.145142+0000","last_undegraded":"2024-04-26T18:08:47.145142+0000","last_fullsized":"2024-04-26T18:08:47.145142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'644","last_scrub_stamp":"2024-04-26T18:08:47.144960+0000","last_deep_scrub":"36'644","last_deep_scrub_stamp":"2024-04-26T18:08:47.144960+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.144960+0000","objects_scrubbed":306,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:06:24.600380+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.061945617000000001,"stat_sum":{"num_bytes":39236247,"num_objects":306,"num_object_clones":0,"num_object_copies":1224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":306,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":644,"num_write_kb":59050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"36'82","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.374586+0000","last_change":"2024-04-26T18:08:37.374586+0000","last_active":"2024-04-26T18:08:37.374586+0000","last_peered":"2024-04-26T18:08:37.374586+0000","last_clean":"2024-04-26T18:08:37.374586+0000","last_became_active":"2024-04-26T17:58:13.493955+0000","last_became_peered":"2024-04-26T17:58:13.493955+0000","last_unstale":"2024-04-26T18:08:37.374586+0000","last_undegraded":"2024-04-26T18:08:37.374586+0000","last_fullsized":"2024-04-26T18:08:37.374586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-04-26T18:08:37.374407+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-04-26T18:08:37.374407+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.374407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:14:08.627829+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.13522821900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'253","reported_seq":313,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.614502+0000","last_change":"2024-04-26T18:08:43.614534+0000","last_active":"2024-04-26T18:08:43.614502+0000","last_peered":"2024-04-26T18:08:43.614502+0000","last_clean":"2024-04-26T18:08:43.614502+0000","last_became_active":"2024-04-26T17:58:12.501067+0000","last_became_peered":"2024-04-26T17:58:12.501067+0000","last_unstale":"2024-04-26T18:08:43.614502+0000","last_undegraded":"2024-04-26T18:08:43.614502+0000","last_fullsized":"2024-04-26T18:08:43.614502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'253","last_scrub_stamp":"2024-04-26T18:08:43.614429+0000","last_deep_scrub":"36'253","last_deep_scrub_stamp":"2024-04-26T18:08:43.614429+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.614429+0000","objects_scrubbed":3,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:13.255566+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":246,"num_write_kb":12437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"36'713","reported_seq":2847,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.541322+0000","last_change":"2024-04-26T18:08:47.541322+0000","last_active":"2024-04-26T18:08:47.541322+0000","last_peered":"2024-04-26T18:08:47.541322+0000","last_clean":"2024-04-26T18:08:47.541322+0000","last_became_active":"2024-04-26T17:58:17.706120+0000","last_became_peered":"2024-04-26T17:58:17.706120+0000","last_unstale":"2024-04-26T18:08:47.541322+0000","last_undegraded":"2024-04-26T18:08:47.541322+0000","last_fullsized":"2024-04-26T18:08:47.541322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'713","last_scrub_stamp":"2024-04-26T18:08:47.541187+0000","last_deep_scrub":"36'713","last_deep_scrub_stamp":"2024-04-26T18:08:47.541187+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.541187+0000","objects_scrubbed":346,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:08:57.186986+0000","scrub_duration":124,"objects_trimmed":0,"snaptrim_duration":0.13300387399999999,"stat_sum":{"num_bytes":25414314,"num_objects":346,"num_object_clones":0,"num_object_copies":1384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":346,"num_whiteouts":0,"num_read":49,"num_read_kb":8237,"num_write":711,"num_write_kb":29139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.555862+0000","last_change":"2024-04-26T18:08:46.555884+0000","last_active":"2024-04-26T18:08:46.555862+0000","last_peered":"2024-04-26T18:08:46.555862+0000","last_clean":"2024-04-26T18:08:46.555862+0000","last_became_active":"2024-04-26T17:58:13.502846+0000","last_became_peered":"2024-04-26T17:58:13.502846+0000","last_unstale":"2024-04-26T18:08:46.555862+0000","last_undegraded":"2024-04-26T18:08:46.555862+0000","last_fullsized":"2024-04-26T18:08:46.555862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:46.555802+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:46.555802+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.555802+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:43:26.734743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14616399199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"36'114","reported_seq":173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.273786+0000","last_change":"2024-04-26T18:08:37.273815+0000","last_active":"2024-04-26T18:08:37.273786+0000","last_peered":"2024-04-26T18:08:37.273786+0000","last_clean":"2024-04-26T18:08:37.273786+0000","last_became_active":"2024-04-26T17:58:12.494613+0000","last_became_peered":"2024-04-26T17:58:12.494613+0000","last_unstale":"2024-04-26T18:08:37.273786+0000","last_undegraded":"2024-04-26T18:08:37.273786+0000","last_fullsized":"2024-04-26T18:08:37.273786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'114","last_scrub_stamp":"2024-04-26T18:08:37.273704+0000","last_deep_scrub":"36'114","last_deep_scrub_stamp":"2024-04-26T18:08:37.273704+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.273704+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:52:51.384474+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":4164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14568,"num_omap_keys":24,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.441015+0000","last_change":"2024-04-26T18:08:37.441058+0000","last_active":"2024-04-26T18:08:37.441015+0000","last_peered":"2024-04-26T18:08:37.441015+0000","last_clean":"2024-04-26T18:08:37.441015+0000","last_became_active":"2024-04-26T17:58:03.018174+0000","last_became_peered":"2024-04-26T17:58:03.018174+0000","last_unstale":"2024-04-26T18:08:37.441015+0000","last_undegraded":"2024-04-26T18:08:37.441015+0000","last_fullsized":"2024-04-26T18:08:37.441015+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-04-26T18:08:37.440924+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-04-26T18:08:37.440924+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.440924+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:36:03.288148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"36'686","reported_seq":2809,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.287474+0000","last_change":"2024-04-26T18:08:49.287525+0000","last_active":"2024-04-26T18:08:49.287474+0000","last_peered":"2024-04-26T18:08:49.287474+0000","last_clean":"2024-04-26T18:08:49.287474+0000","last_became_active":"2024-04-26T17:58:17.707982+0000","last_became_peered":"2024-04-26T17:58:17.707982+0000","last_unstale":"2024-04-26T18:08:49.287474+0000","last_undegraded":"2024-04-26T18:08:49.287474+0000","last_fullsized":"2024-04-26T18:08:49.287474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'686","last_scrub_stamp":"2024-04-26T18:08:49.287381+0000","last_deep_scrub":"36'686","last_deep_scrub_stamp":"2024-04-26T18:08:49.287381+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.287381+0000","objects_scrubbed":379,"log_size":686,"log_dups_size":0,"ondisk_log_size":686,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:35:54.958835+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0.10070833699999999,"stat_sum":{"num_bytes":34911553,"num_objects":379,"num_object_clones":0,"num_object_copies":1516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":379,"num_whiteouts":0,"num_read":35,"num_read_kb":9859,"num_write":685,"num_write_kb":63120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.671240+0000","last_change":"2024-04-26T18:08:46.671263+0000","last_active":"2024-04-26T18:08:46.671240+0000","last_peered":"2024-04-26T18:08:46.671240+0000","last_clean":"2024-04-26T18:08:46.671240+0000","last_became_active":"2024-04-26T17:58:13.502447+0000","last_became_peered":"2024-04-26T17:58:13.502447+0000","last_unstale":"2024-04-26T18:08:46.671240+0000","last_undegraded":"2024-04-26T18:08:46.671240+0000","last_fullsized":"2024-04-26T18:08:46.671240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:46.671164+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:46.671164+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.671164+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:36:14.165417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067468065999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"36'341","reported_seq":400,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.524851+0000","last_change":"2024-04-26T18:08:35.524879+0000","last_active":"2024-04-26T18:08:35.524851+0000","last_peered":"2024-04-26T18:08:35.524851+0000","last_clean":"2024-04-26T18:08:35.524851+0000","last_became_active":"2024-04-26T17:58:12.496812+0000","last_became_peered":"2024-04-26T17:58:12.496812+0000","last_unstale":"2024-04-26T18:08:35.524851+0000","last_undegraded":"2024-04-26T18:08:35.524851+0000","last_fullsized":"2024-04-26T18:08:35.524851+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'341","last_scrub_stamp":"2024-04-26T18:08:35.524787+0000","last_deep_scrub":"36'341","last_deep_scrub_stamp":"2024-04-26T18:08:35.524787+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.524787+0000","objects_scrubbed":4,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:19:19.752481+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":343,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23627,"num_omap_keys":39,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'694","reported_seq":2813,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.267005+0000","last_change":"2024-04-26T18:08:48.267005+0000","last_active":"2024-04-26T18:08:48.267005+0000","last_peered":"2024-04-26T18:08:48.267005+0000","last_clean":"2024-04-26T18:08:48.267005+0000","last_became_active":"2024-04-26T17:58:17.705010+0000","last_became_peered":"2024-04-26T17:58:17.705010+0000","last_unstale":"2024-04-26T18:08:48.267005+0000","last_undegraded":"2024-04-26T18:08:48.267005+0000","last_fullsized":"2024-04-26T18:08:48.267005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'694","last_scrub_stamp":"2024-04-26T18:08:48.266879+0000","last_deep_scrub":"36'694","last_deep_scrub_stamp":"2024-04-26T18:08:48.266879+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.266879+0000","objects_scrubbed":344,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:52:38.547671+0000","scrub_duration":133,"objects_trimmed":0,"snaptrim_duration":0.102433051,"stat_sum":{"num_bytes":20926649,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":33,"num_read_kb":8222,"num_write":693,"num_write_kb":45376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"36'96","reported_seq":2173,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.328501+0000","last_change":"2024-04-26T18:08:41.328522+0000","last_active":"2024-04-26T18:08:41.328501+0000","last_peered":"2024-04-26T18:08:41.328501+0000","last_clean":"2024-04-26T18:08:41.328501+0000","last_became_active":"2024-04-26T17:58:13.498103+0000","last_became_peered":"2024-04-26T17:58:13.498103+0000","last_unstale":"2024-04-26T18:08:41.328501+0000","last_undegraded":"2024-04-26T18:08:41.328501+0000","last_fullsized":"2024-04-26T18:08:41.328501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-04-26T18:08:41.328433+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-04-26T18:08:41.328433+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.328433+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:49:16.627314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073632,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.874892+0000","last_change":"2024-04-26T18:08:34.874924+0000","last_active":"2024-04-26T18:08:34.874892+0000","last_peered":"2024-04-26T18:08:34.874892+0000","last_clean":"2024-04-26T18:08:34.874892+0000","last_became_active":"2024-04-26T17:58:12.497752+0000","last_became_peered":"2024-04-26T17:58:12.497752+0000","last_unstale":"2024-04-26T18:08:34.874892+0000","last_undegraded":"2024-04-26T18:08:34.874892+0000","last_fullsized":"2024-04-26T18:08:34.874892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-04-26T18:08:34.874814+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-04-26T18:08:34.874814+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.874814+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:02:55.613011+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36218,"num_omap_keys":62,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'661","reported_seq":2784,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.556130+0000","last_change":"2024-04-26T18:08:45.556166+0000","last_active":"2024-04-26T18:08:45.556130+0000","last_peered":"2024-04-26T18:08:45.556130+0000","last_clean":"2024-04-26T18:08:45.556130+0000","last_became_active":"2024-04-26T17:58:17.542032+0000","last_became_peered":"2024-04-26T17:58:17.542032+0000","last_unstale":"2024-04-26T18:08:45.556130+0000","last_undegraded":"2024-04-26T18:08:45.556130+0000","last_fullsized":"2024-04-26T18:08:45.556130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'661","last_scrub_stamp":"2024-04-26T18:08:45.556049+0000","last_deep_scrub":"36'661","last_deep_scrub_stamp":"2024-04-26T18:08:45.556049+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.556049+0000","objects_scrubbed":334,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:25:18.770571+0000","scrub_duration":105,"objects_trimmed":0,"snaptrim_duration":0.11918287399999999,"stat_sum":{"num_bytes":10723678,"num_objects":334,"num_object_clones":0,"num_object_copies":1336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":334,"num_whiteouts":0,"num_read":38,"num_read_kb":4132,"num_write":660,"num_write_kb":31302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"36'87","reported_seq":2165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.635344+0000","last_change":"2024-04-26T18:08:49.635383+0000","last_active":"2024-04-26T18:08:49.635344+0000","last_peered":"2024-04-26T18:08:49.635344+0000","last_clean":"2024-04-26T18:08:49.635344+0000","last_became_active":"2024-04-26T17:58:13.504756+0000","last_became_peered":"2024-04-26T17:58:13.504756+0000","last_unstale":"2024-04-26T18:08:49.635344+0000","last_undegraded":"2024-04-26T18:08:49.635344+0000","last_fullsized":"2024-04-26T18:08:49.635344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-04-26T18:08:49.635251+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-04-26T18:08:49.635251+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.635251+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:39:10.544680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063774767999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'116","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.518753+0000","last_change":"2024-04-26T18:08:34.518798+0000","last_active":"2024-04-26T18:08:34.518753+0000","last_peered":"2024-04-26T18:08:34.518753+0000","last_clean":"2024-04-26T18:08:34.518753+0000","last_became_active":"2024-04-26T17:58:12.494049+0000","last_became_peered":"2024-04-26T17:58:12.494049+0000","last_unstale":"2024-04-26T18:08:34.518753+0000","last_undegraded":"2024-04-26T18:08:34.518753+0000","last_fullsized":"2024-04-26T18:08:34.518753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'116","last_scrub_stamp":"2024-04-26T18:08:34.518680+0000","last_deep_scrub":"36'116","last_deep_scrub_stamp":"2024-04-26T18:08:34.518680+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.518680+0000","objects_scrubbed":3,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:53:20.463081+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":4174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8487,"num_omap_keys":15,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"36'672","reported_seq":2795,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.512987+0000","last_change":"2024-04-26T18:08:50.512987+0000","last_active":"2024-04-26T18:08:50.512987+0000","last_peered":"2024-04-26T18:08:50.512987+0000","last_clean":"2024-04-26T18:08:50.512987+0000","last_became_active":"2024-04-26T17:58:17.707880+0000","last_became_peered":"2024-04-26T17:58:17.707880+0000","last_unstale":"2024-04-26T18:08:50.512987+0000","last_undegraded":"2024-04-26T18:08:50.512987+0000","last_fullsized":"2024-04-26T18:08:50.512987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'672","last_scrub_stamp":"2024-04-26T18:08:50.512845+0000","last_deep_scrub":"36'672","last_deep_scrub_stamp":"2024-04-26T18:08:50.512845+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.512845+0000","objects_scrubbed":325,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:16:51.956159+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.101950094,"stat_sum":{"num_bytes":26399096,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":37,"num_read_kb":16416,"num_write":672,"num_write_kb":42492,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"36'66","reported_seq":2144,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.644247+0000","last_change":"2024-04-26T18:08:47.644268+0000","last_active":"2024-04-26T18:08:47.644247+0000","last_peered":"2024-04-26T18:08:47.644247+0000","last_clean":"2024-04-26T18:08:47.644247+0000","last_became_active":"2024-04-26T17:58:13.503283+0000","last_became_peered":"2024-04-26T17:58:13.503283+0000","last_unstale":"2024-04-26T18:08:47.644247+0000","last_undegraded":"2024-04-26T18:08:47.644247+0000","last_fullsized":"2024-04-26T18:08:47.644247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-26T18:08:47.644178+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-26T18:08:47.644178+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.644178+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:15:32.449389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067049634999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"36'66","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.089159+0000","last_change":"2024-04-26T18:08:34.089195+0000","last_active":"2024-04-26T18:08:34.089159+0000","last_peered":"2024-04-26T18:08:34.089159+0000","last_clean":"2024-04-26T18:08:34.089159+0000","last_became_active":"2024-04-26T17:58:12.493505+0000","last_became_peered":"2024-04-26T17:58:12.493505+0000","last_unstale":"2024-04-26T18:08:34.089159+0000","last_undegraded":"2024-04-26T18:08:34.089159+0000","last_fullsized":"2024-04-26T18:08:34.089159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'66","last_scrub_stamp":"2024-04-26T18:08:34.089065+0000","last_deep_scrub":"36'66","last_deep_scrub_stamp":"2024-04-26T18:08:34.089065+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.089065+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:13:22.700639+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":4158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23020,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'698","reported_seq":2842,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.212164+0000","last_change":"2024-04-26T18:08:42.212164+0000","last_active":"2024-04-26T18:08:42.212164+0000","last_peered":"2024-04-26T18:08:42.212164+0000","last_clean":"2024-04-26T18:08:42.212164+0000","last_became_active":"2024-04-26T17:58:17.536884+0000","last_became_peered":"2024-04-26T17:58:17.536884+0000","last_unstale":"2024-04-26T18:08:42.212164+0000","last_undegraded":"2024-04-26T18:08:42.212164+0000","last_fullsized":"2024-04-26T18:08:42.212164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'698","last_scrub_stamp":"2024-04-26T18:08:42.212050+0000","last_deep_scrub":"36'698","last_deep_scrub_stamp":"2024-04-26T18:08:42.212050+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.212050+0000","objects_scrubbed":336,"log_size":698,"log_dups_size":0,"ondisk_log_size":698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:11.655082+0000","scrub_duration":140,"objects_trimmed":0,"snaptrim_duration":0.123067431,"stat_sum":{"num_bytes":51280712,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":58,"num_read_kb":41001,"num_write":698,"num_write_kb":75015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"36'90","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.627612+0000","last_change":"2024-04-26T18:08:45.627635+0000","last_active":"2024-04-26T18:08:45.627612+0000","last_peered":"2024-04-26T18:08:45.627612+0000","last_clean":"2024-04-26T18:08:45.627612+0000","last_became_active":"2024-04-26T17:58:13.502251+0000","last_became_peered":"2024-04-26T17:58:13.502251+0000","last_unstale":"2024-04-26T18:08:45.627612+0000","last_undegraded":"2024-04-26T18:08:45.627612+0000","last_fullsized":"2024-04-26T18:08:45.627612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:45.627541+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:45.627541+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.627541+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:50.259358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071274376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"36'78","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.538709+0000","last_change":"2024-04-26T18:08:36.538749+0000","last_active":"2024-04-26T18:08:36.538709+0000","last_peered":"2024-04-26T18:08:36.538709+0000","last_clean":"2024-04-26T18:08:36.538709+0000","last_became_active":"2024-04-26T17:58:12.501308+0000","last_became_peered":"2024-04-26T17:58:12.501308+0000","last_unstale":"2024-04-26T18:08:36.538709+0000","last_undegraded":"2024-04-26T18:08:36.538709+0000","last_fullsized":"2024-04-26T18:08:36.538709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'78","last_scrub_stamp":"2024-04-26T18:08:36.538625+0000","last_deep_scrub":"36'78","last_deep_scrub_stamp":"2024-04-26T18:08:36.538625+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.538625+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:41.869490+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6677,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"36'663","reported_seq":2785,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.549726+0000","last_change":"2024-04-26T18:08:44.549773+0000","last_active":"2024-04-26T18:08:44.549726+0000","last_peered":"2024-04-26T18:08:44.549726+0000","last_clean":"2024-04-26T18:08:44.549726+0000","last_became_active":"2024-04-26T17:58:17.540563+0000","last_became_peered":"2024-04-26T17:58:17.540563+0000","last_unstale":"2024-04-26T18:08:44.549726+0000","last_undegraded":"2024-04-26T18:08:44.549726+0000","last_fullsized":"2024-04-26T18:08:44.549726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'663","last_scrub_stamp":"2024-04-26T18:08:44.549638+0000","last_deep_scrub":"36'663","last_deep_scrub_stamp":"2024-04-26T18:08:44.549638+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.549638+0000","objects_scrubbed":297,"log_size":663,"log_dups_size":0,"ondisk_log_size":663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:38:11.567301+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.13014584500000001,"stat_sum":{"num_bytes":29750972,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":39,"num_read_kb":7212,"num_write":662,"num_write_kb":41643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.187066+0000","last_change":"2024-04-26T18:08:43.187109+0000","last_active":"2024-04-26T18:08:43.187066+0000","last_peered":"2024-04-26T18:08:43.187066+0000","last_clean":"2024-04-26T18:08:43.187066+0000","last_became_active":"2024-04-26T17:58:13.490903+0000","last_became_peered":"2024-04-26T17:58:13.490903+0000","last_unstale":"2024-04-26T18:08:43.187066+0000","last_undegraded":"2024-04-26T18:08:43.187066+0000","last_fullsized":"2024-04-26T18:08:43.187066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:43.186981+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:43.186981+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.186981+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:43:23.669897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100632764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'5","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.061558+0000","last_change":"2024-04-26T18:08:38.061593+0000","last_active":"2024-04-26T18:08:38.061558+0000","last_peered":"2024-04-26T18:08:38.061558+0000","last_clean":"2024-04-26T18:08:38.061558+0000","last_became_active":"2024-04-26T17:58:12.689062+0000","last_became_peered":"2024-04-26T17:58:12.689062+0000","last_unstale":"2024-04-26T18:08:38.061558+0000","last_undegraded":"2024-04-26T18:08:38.061558+0000","last_fullsized":"2024-04-26T18:08:38.061558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-04-26T18:08:38.061463+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-04-26T18:08:38.061463+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.061463+0000","objects_scrubbed":3,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:58.668256+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35068,"num_omap_keys":58,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"36'651","reported_seq":2779,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.585887+0000","last_change":"2024-04-26T18:08:50.585914+0000","last_active":"2024-04-26T18:08:50.585887+0000","last_peered":"2024-04-26T18:08:50.585887+0000","last_clean":"2024-04-26T18:08:50.585887+0000","last_became_active":"2024-04-26T17:58:17.708018+0000","last_became_peered":"2024-04-26T17:58:17.708018+0000","last_unstale":"2024-04-26T18:08:50.585887+0000","last_undegraded":"2024-04-26T18:08:50.585887+0000","last_fullsized":"2024-04-26T18:08:50.585887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'651","last_scrub_stamp":"2024-04-26T18:08:50.585802+0000","last_deep_scrub":"36'651","last_deep_scrub_stamp":"2024-04-26T18:08:50.585802+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.585802+0000","objects_scrubbed":326,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:12.821329+0000","scrub_duration":116,"objects_trimmed":0,"snaptrim_duration":0.149150915,"stat_sum":{"num_bytes":21523092,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":43,"num_read_kb":16421,"num_write":652,"num_write_kb":58183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'101","reported_seq":2179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.363373+0000","last_change":"2024-04-26T18:08:35.363402+0000","last_active":"2024-04-26T18:08:35.363373+0000","last_peered":"2024-04-26T18:08:35.363373+0000","last_clean":"2024-04-26T18:08:35.363373+0000","last_became_active":"2024-04-26T17:58:13.502333+0000","last_became_peered":"2024-04-26T17:58:13.502333+0000","last_unstale":"2024-04-26T18:08:35.363373+0000","last_undegraded":"2024-04-26T18:08:35.363373+0000","last_fullsized":"2024-04-26T18:08:35.363373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'101","last_scrub_stamp":"2024-04-26T18:08:35.363288+0000","last_deep_scrub":"36'101","last_deep_scrub_stamp":"2024-04-26T18:08:35.363288+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.363288+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:03:14.215624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061255275999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.310759+0000","last_change":"2024-04-26T18:08:38.310788+0000","last_active":"2024-04-26T18:08:38.310759+0000","last_peered":"2024-04-26T18:08:38.310759+0000","last_clean":"2024-04-26T18:08:38.310759+0000","last_became_active":"2024-04-26T17:58:12.494494+0000","last_became_peered":"2024-04-26T17:58:12.494494+0000","last_unstale":"2024-04-26T18:08:38.310759+0000","last_undegraded":"2024-04-26T18:08:38.310759+0000","last_fullsized":"2024-04-26T18:08:38.310759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T18:08:38.310653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T18:08:38.310653+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.310653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:22:53.217830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"36'610","reported_seq":2721,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.621490+0000","last_change":"2024-04-26T18:08:49.621521+0000","last_active":"2024-04-26T18:08:49.621490+0000","last_peered":"2024-04-26T18:08:49.621490+0000","last_clean":"2024-04-26T18:08:49.621490+0000","last_became_active":"2024-04-26T17:58:17.705114+0000","last_became_peered":"2024-04-26T17:58:17.705114+0000","last_unstale":"2024-04-26T18:08:49.621490+0000","last_undegraded":"2024-04-26T18:08:49.621490+0000","last_fullsized":"2024-04-26T18:08:49.621490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'610","last_scrub_stamp":"2024-04-26T18:08:49.621409+0000","last_deep_scrub":"36'610","last_deep_scrub_stamp":"2024-04-26T18:08:49.621409+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.621409+0000","objects_scrubbed":311,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:47:32.751299+0000","scrub_duration":121,"objects_trimmed":0,"snaptrim_duration":0.141870835,"stat_sum":{"num_bytes":34207513,"num_objects":311,"num_object_clones":0,"num_object_copies":1244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":311,"num_whiteouts":0,"num_read":27,"num_read_kb":11247,"num_write":607,"num_write_kb":58282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.327640+0000","last_change":"2024-04-26T18:08:41.327663+0000","last_active":"2024-04-26T18:08:41.327640+0000","last_peered":"2024-04-26T18:08:41.327640+0000","last_clean":"2024-04-26T18:08:41.327640+0000","last_became_active":"2024-04-26T17:58:13.496768+0000","last_became_peered":"2024-04-26T17:58:13.496768+0000","last_unstale":"2024-04-26T18:08:41.327640+0000","last_undegraded":"2024-04-26T18:08:41.327640+0000","last_fullsized":"2024-04-26T18:08:41.327640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:41.327567+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:41.327567+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.327567+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:07:23.324119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11062596700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'19","reported_seq":78,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.349150+0000","last_change":"2024-04-26T18:08:33.349202+0000","last_active":"2024-04-26T18:08:33.349150+0000","last_peered":"2024-04-26T18:08:33.349150+0000","last_clean":"2024-04-26T18:08:33.349150+0000","last_became_active":"2024-04-26T17:58:12.496187+0000","last_became_peered":"2024-04-26T17:58:12.496187+0000","last_unstale":"2024-04-26T18:08:33.349150+0000","last_undegraded":"2024-04-26T18:08:33.349150+0000","last_fullsized":"2024-04-26T18:08:33.349150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'19","last_scrub_stamp":"2024-04-26T18:08:33.349041+0000","last_deep_scrub":"36'19","last_deep_scrub_stamp":"2024-04-26T18:08:33.349041+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.349041+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:26:33.873287+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":8227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":28494,"num_omap_keys":50,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'644","reported_seq":2770,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:49.480541+0000","last_change":"2024-04-26T18:08:49.480587+0000","last_active":"2024-04-26T18:08:49.480541+0000","last_peered":"2024-04-26T18:08:49.480541+0000","last_clean":"2024-04-26T18:08:49.480541+0000","last_became_active":"2024-04-26T17:58:17.705089+0000","last_became_peered":"2024-04-26T17:58:17.705089+0000","last_unstale":"2024-04-26T18:08:49.480541+0000","last_undegraded":"2024-04-26T18:08:49.480541+0000","last_fullsized":"2024-04-26T18:08:49.480541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'644","last_scrub_stamp":"2024-04-26T18:08:49.480460+0000","last_deep_scrub":"36'644","last_deep_scrub_stamp":"2024-04-26T18:08:49.480460+0000","last_clean_scrub_stamp":"2024-04-26T18:08:49.480460+0000","objects_scrubbed":317,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:33:55.273955+0000","scrub_duration":118,"objects_trimmed":0,"snaptrim_duration":0.105574502,"stat_sum":{"num_bytes":36480532,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":42,"num_read_kb":10705,"num_write":644,"num_write_kb":40030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"36'83","reported_seq":2161,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:50.646501+0000","last_change":"2024-04-26T18:08:50.646537+0000","last_active":"2024-04-26T18:08:50.646501+0000","last_peered":"2024-04-26T18:08:50.646501+0000","last_clean":"2024-04-26T18:08:50.646501+0000","last_became_active":"2024-04-26T17:58:13.504904+0000","last_became_peered":"2024-04-26T17:58:13.504904+0000","last_unstale":"2024-04-26T18:08:50.646501+0000","last_undegraded":"2024-04-26T18:08:50.646501+0000","last_fullsized":"2024-04-26T18:08:50.646501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:50.646427+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:50.646427+0000","last_clean_scrub_stamp":"2024-04-26T18:08:50.646427+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:52:12.376566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067271265999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"36'167","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.510327+0000","last_change":"2024-04-26T18:08:35.134594+0000","last_active":"2024-04-26T18:08:39.510327+0000","last_peered":"2024-04-26T18:08:39.510327+0000","last_clean":"2024-04-26T18:08:39.510327+0000","last_became_active":"2024-04-26T17:58:12.491920+0000","last_became_peered":"2024-04-26T17:58:12.491920+0000","last_unstale":"2024-04-26T18:08:39.510327+0000","last_undegraded":"2024-04-26T18:08:39.510327+0000","last_fullsized":"2024-04-26T18:08:39.510327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'165","last_scrub_stamp":"2024-04-26T18:08:35.134470+0000","last_deep_scrub":"36'165","last_deep_scrub_stamp":"2024-04-26T18:08:35.134470+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.134470+0000","objects_scrubbed":9,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:54:16.404818+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":12431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":34930,"num_omap_keys":58,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"36'664","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.118095+0000","last_change":"2024-04-26T18:08:48.118151+0000","last_active":"2024-04-26T18:08:48.118095+0000","last_peered":"2024-04-26T18:08:48.118095+0000","last_clean":"2024-04-26T18:08:48.118095+0000","last_became_active":"2024-04-26T17:58:17.542288+0000","last_became_peered":"2024-04-26T17:58:17.542288+0000","last_unstale":"2024-04-26T18:08:48.118095+0000","last_undegraded":"2024-04-26T18:08:48.118095+0000","last_fullsized":"2024-04-26T18:08:48.118095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'664","last_scrub_stamp":"2024-04-26T18:08:48.118000+0000","last_deep_scrub":"36'664","last_deep_scrub_stamp":"2024-04-26T18:08:48.118000+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.118000+0000","objects_scrubbed":331,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:36:10.365795+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.059492332000000002,"stat_sum":{"num_bytes":21881551,"num_objects":331,"num_object_clones":0,"num_object_copies":1324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":331,"num_whiteouts":0,"num_read":44,"num_read_kb":15173,"num_write":663,"num_write_kb":46216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'86","reported_seq":2164,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.095654+0000","last_change":"2024-04-26T18:08:38.095681+0000","last_active":"2024-04-26T18:08:38.095654+0000","last_peered":"2024-04-26T18:08:38.095654+0000","last_clean":"2024-04-26T18:08:38.095654+0000","last_became_active":"2024-04-26T17:58:13.497845+0000","last_became_peered":"2024-04-26T17:58:13.497845+0000","last_unstale":"2024-04-26T18:08:38.095654+0000","last_undegraded":"2024-04-26T18:08:38.095654+0000","last_fullsized":"2024-04-26T18:08:38.095654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'86","last_scrub_stamp":"2024-04-26T18:08:38.095573+0000","last_deep_scrub":"36'86","last_deep_scrub_stamp":"2024-04-26T18:08:38.095573+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.095573+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:58:52.836709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.119578702,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"36'340","reported_seq":399,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.996033+0000","last_change":"2024-04-26T18:08:39.996066+0000","last_active":"2024-04-26T18:08:39.996033+0000","last_peered":"2024-04-26T18:08:39.996033+0000","last_clean":"2024-04-26T18:08:39.996033+0000","last_became_active":"2024-04-26T17:58:12.500288+0000","last_became_peered":"2024-04-26T17:58:12.500288+0000","last_unstale":"2024-04-26T18:08:39.996033+0000","last_undegraded":"2024-04-26T18:08:39.996033+0000","last_fullsized":"2024-04-26T18:08:39.996033+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'340","last_scrub_stamp":"2024-04-26T18:08:39.995948+0000","last_deep_scrub":"36'340","last_deep_scrub_stamp":"2024-04-26T18:08:39.995948+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.995948+0000","objects_scrubbed":8,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:35:36.487613+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":335,"num_write_kb":12535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22652,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'654","reported_seq":2793,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.273736+0000","last_change":"2024-04-26T18:08:48.273762+0000","last_active":"2024-04-26T18:08:48.273736+0000","last_peered":"2024-04-26T18:08:48.273736+0000","last_clean":"2024-04-26T18:08:48.273736+0000","last_became_active":"2024-04-26T17:58:55.642361+0000","last_became_peered":"2024-04-26T17:58:55.642361+0000","last_unstale":"2024-04-26T18:08:48.273736+0000","last_undegraded":"2024-04-26T18:08:48.273736+0000","last_fullsized":"2024-04-26T18:08:48.273736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'654","last_scrub_stamp":"2024-04-26T18:08:48.273665+0000","last_deep_scrub":"36'654","last_deep_scrub_stamp":"2024-04-26T18:08:48.273665+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.273665+0000","objects_scrubbed":329,"log_size":654,"log_dups_size":0,"ondisk_log_size":654,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:05.742307+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.12080484800000001,"stat_sum":{"num_bytes":25293347,"num_objects":329,"num_object_clones":0,"num_object_copies":1316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":329,"num_whiteouts":0,"num_read":47,"num_read_kb":8235,"num_write":654,"num_write_kb":45477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"36'89","reported_seq":2167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.328878+0000","last_change":"2024-04-26T18:08:39.328904+0000","last_active":"2024-04-26T18:08:39.328878+0000","last_peered":"2024-04-26T18:08:39.328878+0000","last_clean":"2024-04-26T18:08:39.328878+0000","last_became_active":"2024-04-26T17:58:13.495338+0000","last_became_peered":"2024-04-26T17:58:13.495338+0000","last_unstale":"2024-04-26T18:08:39.328878+0000","last_undegraded":"2024-04-26T18:08:39.328878+0000","last_fullsized":"2024-04-26T18:08:39.328878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'89","last_scrub_stamp":"2024-04-26T18:08:39.328796+0000","last_deep_scrub":"36'89","last_deep_scrub_stamp":"2024-04-26T18:08:39.328796+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.328796+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:40:24.770163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13078383399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"36'595","reported_seq":653,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.300350+0000","last_change":"2024-04-26T18:08:35.300387+0000","last_active":"2024-04-26T18:08:35.300350+0000","last_peered":"2024-04-26T18:08:35.300350+0000","last_clean":"2024-04-26T18:08:35.300350+0000","last_became_active":"2024-04-26T17:58:12.490894+0000","last_became_peered":"2024-04-26T17:58:12.490894+0000","last_unstale":"2024-04-26T18:08:35.300350+0000","last_undegraded":"2024-04-26T18:08:35.300350+0000","last_fullsized":"2024-04-26T18:08:35.300350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'595","last_scrub_stamp":"2024-04-26T18:08:35.300277+0000","last_deep_scrub":"36'595","last_deep_scrub_stamp":"2024-04-26T18:08:35.300277+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.300277+0000","objects_scrubbed":9,"log_size":595,"log_dups_size":0,"ondisk_log_size":595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:21:47.187338+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":16973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30957,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"36'704","reported_seq":2830,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.656913+0000","last_change":"2024-04-26T18:08:47.656947+0000","last_active":"2024-04-26T18:08:47.656913+0000","last_peered":"2024-04-26T18:08:47.656913+0000","last_clean":"2024-04-26T18:08:47.656913+0000","last_became_active":"2024-04-26T17:58:17.533937+0000","last_became_peered":"2024-04-26T17:58:17.533937+0000","last_unstale":"2024-04-26T18:08:47.656913+0000","last_undegraded":"2024-04-26T18:08:47.656913+0000","last_fullsized":"2024-04-26T18:08:47.656913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'704","last_scrub_stamp":"2024-04-26T18:08:47.656825+0000","last_deep_scrub":"36'704","last_deep_scrub_stamp":"2024-04-26T18:08:47.656825+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.656825+0000","objects_scrubbed":354,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:32.572949+0000","scrub_duration":138,"objects_trimmed":0,"snaptrim_duration":0.141114079,"stat_sum":{"num_bytes":47663058,"num_objects":354,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":354,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":698,"num_write_kb":58384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"36'105","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.434000+0000","last_change":"2024-04-26T18:08:41.434028+0000","last_active":"2024-04-26T18:08:41.434000+0000","last_peered":"2024-04-26T18:08:41.434000+0000","last_clean":"2024-04-26T18:08:41.434000+0000","last_became_active":"2024-04-26T17:58:55.722414+0000","last_became_peered":"2024-04-26T17:58:55.722414+0000","last_unstale":"2024-04-26T18:08:41.434000+0000","last_undegraded":"2024-04-26T18:08:41.434000+0000","last_fullsized":"2024-04-26T18:08:41.434000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'105","last_scrub_stamp":"2024-04-26T18:08:41.433911+0000","last_deep_scrub":"36'105","last_deep_scrub_stamp":"2024-04-26T18:08:41.433911+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.433911+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:17:55.230156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037157691999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"36'5","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.032309+0000","last_change":"2024-04-26T18:08:37.032356+0000","last_active":"2024-04-26T18:08:37.032309+0000","last_peered":"2024-04-26T18:08:37.032309+0000","last_clean":"2024-04-26T18:08:37.032309+0000","last_became_active":"2024-04-26T17:58:12.496401+0000","last_became_peered":"2024-04-26T17:58:12.496401+0000","last_unstale":"2024-04-26T18:08:37.032309+0000","last_undegraded":"2024-04-26T18:08:37.032309+0000","last_fullsized":"2024-04-26T18:08:37.032309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-04-26T18:08:37.032204+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-04-26T18:08:37.032204+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.032204+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:25:54.630469+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18977,"num_omap_keys":32,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'695","reported_seq":2828,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:52.642714+0000","last_change":"2024-04-26T18:08:52.642750+0000","last_active":"2024-04-26T18:08:52.642714+0000","last_peered":"2024-04-26T18:08:52.642714+0000","last_clean":"2024-04-26T18:08:52.642714+0000","last_became_active":"2024-04-26T17:58:17.709097+0000","last_became_peered":"2024-04-26T17:58:17.709097+0000","last_unstale":"2024-04-26T18:08:52.642714+0000","last_undegraded":"2024-04-26T18:08:52.642714+0000","last_fullsized":"2024-04-26T18:08:52.642714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'695","last_scrub_stamp":"2024-04-26T18:08:52.642628+0000","last_deep_scrub":"36'695","last_deep_scrub_stamp":"2024-04-26T18:08:52.642628+0000","last_clean_scrub_stamp":"2024-04-26T18:08:52.642628+0000","objects_scrubbed":361,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:00:20.067709+0000","scrub_duration":149,"objects_trimmed":0,"snaptrim_duration":0.149920109,"stat_sum":{"num_bytes":49569926,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":47,"num_read_kb":22345,"num_write":696,"num_write_kb":69201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"36'660","reported_seq":2783,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.579876+0000","last_change":"2024-04-26T18:08:48.579909+0000","last_active":"2024-04-26T18:08:48.579876+0000","last_peered":"2024-04-26T18:08:48.579876+0000","last_clean":"2024-04-26T18:08:48.579876+0000","last_became_active":"2024-04-26T17:58:55.723387+0000","last_became_peered":"2024-04-26T17:58:55.723387+0000","last_unstale":"2024-04-26T18:08:48.579876+0000","last_undegraded":"2024-04-26T18:08:48.579876+0000","last_fullsized":"2024-04-26T18:08:48.579876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'660","last_scrub_stamp":"2024-04-26T18:08:48.579798+0000","last_deep_scrub":"36'660","last_deep_scrub_stamp":"2024-04-26T18:08:48.579798+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.579798+0000","objects_scrubbed":336,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:11:08.351222+0000","scrub_duration":126,"objects_trimmed":0,"snaptrim_duration":0.13132527499999999,"stat_sum":{"num_bytes":20313576,"num_objects":336,"num_object_clones":0,"num_object_copies":1344,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":336,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":660,"num_write_kb":36563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"36'93","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.910675+0000","last_change":"2024-04-26T18:08:43.910707+0000","last_active":"2024-04-26T18:08:43.910675+0000","last_peered":"2024-04-26T18:08:43.910675+0000","last_clean":"2024-04-26T18:08:43.910675+0000","last_became_active":"2024-04-26T17:58:13.505457+0000","last_became_peered":"2024-04-26T17:58:13.505457+0000","last_unstale":"2024-04-26T18:08:43.910675+0000","last_undegraded":"2024-04-26T18:08:43.910675+0000","last_fullsized":"2024-04-26T18:08:43.910675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'93","last_scrub_stamp":"2024-04-26T18:08:43.910584+0000","last_deep_scrub":"36'93","last_deep_scrub_stamp":"2024-04-26T18:08:43.910584+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.910584+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:16:52.379335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.061493925999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"36'59","reported_seq":117,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.291127+0000","last_change":"2024-04-26T18:08:36.291163+0000","last_active":"2024-04-26T18:08:36.291127+0000","last_peered":"2024-04-26T18:08:36.291127+0000","last_clean":"2024-04-26T18:08:36.291127+0000","last_became_active":"2024-04-26T17:58:12.494338+0000","last_became_peered":"2024-04-26T17:58:12.494338+0000","last_unstale":"2024-04-26T18:08:36.291127+0000","last_undegraded":"2024-04-26T18:08:36.291127+0000","last_fullsized":"2024-04-26T18:08:36.291127+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'59","last_scrub_stamp":"2024-04-26T18:08:36.291050+0000","last_deep_scrub":"36'59","last_deep_scrub_stamp":"2024-04-26T18:08:36.291050+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.291050+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:56.422369+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":16431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":23397,"num_omap_keys":39,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"36'655","reported_seq":2781,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.289457+0000","last_change":"2024-04-26T18:08:47.289515+0000","last_active":"2024-04-26T18:08:47.289457+0000","last_peered":"2024-04-26T18:08:47.289457+0000","last_clean":"2024-04-26T18:08:47.289457+0000","last_became_active":"2024-04-26T17:58:17.535739+0000","last_became_peered":"2024-04-26T17:58:17.535739+0000","last_unstale":"2024-04-26T18:08:47.289457+0000","last_undegraded":"2024-04-26T18:08:47.289457+0000","last_fullsized":"2024-04-26T18:08:47.289457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'655","last_scrub_stamp":"2024-04-26T18:08:47.289338+0000","last_deep_scrub":"36'655","last_deep_scrub_stamp":"2024-04-26T18:08:47.289338+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.289338+0000","objects_scrubbed":332,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T05:17:58.635987+0000","scrub_duration":139,"objects_trimmed":0,"snaptrim_duration":0.10117559,"stat_sum":{"num_bytes":41142397,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":40,"num_read_kb":16130,"num_write":654,"num_write_kb":48705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"36'110","reported_seq":2188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.523697+0000","last_change":"2024-04-26T18:08:45.523751+0000","last_active":"2024-04-26T18:08:45.523697+0000","last_peered":"2024-04-26T18:08:45.523697+0000","last_clean":"2024-04-26T18:08:45.523697+0000","last_became_active":"2024-04-26T17:58:13.498027+0000","last_became_peered":"2024-04-26T17:58:13.498027+0000","last_unstale":"2024-04-26T18:08:45.523697+0000","last_undegraded":"2024-04-26T18:08:45.523697+0000","last_fullsized":"2024-04-26T18:08:45.523697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'110","last_scrub_stamp":"2024-04-26T18:08:45.523611+0000","last_deep_scrub":"36'110","last_deep_scrub_stamp":"2024-04-26T18:08:45.523611+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.523611+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:12:59.576452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13992951300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"36'27","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.511615+0000","last_change":"2024-04-26T18:08:38.511651+0000","last_active":"2024-04-26T18:08:38.511615+0000","last_peered":"2024-04-26T18:08:38.511615+0000","last_clean":"2024-04-26T18:08:38.511615+0000","last_became_active":"2024-04-26T17:58:12.490324+0000","last_became_peered":"2024-04-26T17:58:12.490324+0000","last_unstale":"2024-04-26T18:08:38.511615+0000","last_undegraded":"2024-04-26T18:08:38.511615+0000","last_fullsized":"2024-04-26T18:08:38.511615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'27","last_scrub_stamp":"2024-04-26T18:08:38.511525+0000","last_deep_scrub":"36'27","last_deep_scrub_stamp":"2024-04-26T18:08:38.511525+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.511525+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:53:41.431052+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7886,"num_omap_keys":14,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"36'1632","reported_seq":1691,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:09:04.516481+0000","last_change":"2024-04-26T18:08:39.133009+0000","last_active":"2024-04-26T18:09:04.516481+0000","last_peered":"2024-04-26T18:09:04.516481+0000","last_clean":"2024-04-26T18:09:04.516481+0000","last_became_active":"2024-04-26T17:58:12.689006+0000","last_became_peered":"2024-04-26T17:58:12.689006+0000","last_unstale":"2024-04-26T18:09:04.516481+0000","last_undegraded":"2024-04-26T18:09:04.516481+0000","last_fullsized":"2024-04-26T18:09:04.516481+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'1580","last_scrub_stamp":"2024-04-26T18:08:39.132880+0000","last_deep_scrub":"36'1580","last_deep_scrub_stamp":"2024-04-26T18:08:39.132880+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.132880+0000","objects_scrubbed":6,"log_size":1632,"log_dups_size":0,"ondisk_log_size":1632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:22:40.656186+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20037470,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1625,"num_write_kb":20741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"36'91","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.381965+0000","last_change":"2024-04-26T18:08:36.381992+0000","last_active":"2024-04-26T18:08:36.381965+0000","last_peered":"2024-04-26T18:08:36.381965+0000","last_clean":"2024-04-26T18:08:36.381965+0000","last_became_active":"2024-04-26T17:58:13.493299+0000","last_became_peered":"2024-04-26T17:58:13.493299+0000","last_unstale":"2024-04-26T18:08:36.381965+0000","last_undegraded":"2024-04-26T18:08:36.381965+0000","last_fullsized":"2024-04-26T18:08:36.381965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:36.381891+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:36.381891+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.381891+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:11:33.673810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.11839501500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'646","reported_seq":2755,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.562250+0000","last_change":"2024-04-26T18:08:39.562286+0000","last_active":"2024-04-26T18:08:39.562250+0000","last_peered":"2024-04-26T18:08:39.562250+0000","last_clean":"2024-04-26T18:08:39.562250+0000","last_became_active":"2024-04-26T17:58:17.533419+0000","last_became_peered":"2024-04-26T17:58:17.533419+0000","last_unstale":"2024-04-26T18:08:39.562250+0000","last_undegraded":"2024-04-26T18:08:39.562250+0000","last_fullsized":"2024-04-26T18:08:39.562250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'646","last_scrub_stamp":"2024-04-26T18:08:39.562161+0000","last_deep_scrub":"36'646","last_deep_scrub_stamp":"2024-04-26T18:08:39.562161+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.562161+0000","objects_scrubbed":342,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T06:02:04.607634+0000","scrub_duration":128,"objects_trimmed":0,"snaptrim_duration":0.033941849000000003,"stat_sum":{"num_bytes":20301607,"num_objects":342,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":342,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":644,"num_write_kb":32450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"36'56","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.512629+0000","last_change":"2024-04-26T18:08:39.512659+0000","last_active":"2024-04-26T18:08:39.512629+0000","last_peered":"2024-04-26T18:08:39.512629+0000","last_clean":"2024-04-26T18:08:39.512629+0000","last_became_active":"2024-04-26T17:58:12.494550+0000","last_became_peered":"2024-04-26T17:58:12.494550+0000","last_unstale":"2024-04-26T18:08:39.512629+0000","last_undegraded":"2024-04-26T18:08:39.512629+0000","last_fullsized":"2024-04-26T18:08:39.512629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'56","last_scrub_stamp":"2024-04-26T18:08:39.512559+0000","last_deep_scrub":"36'56","last_deep_scrub_stamp":"2024-04-26T18:08:39.512559+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.512559+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:50:01.864596+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11569,"num_omap_keys":19,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:39.073960+0000","last_change":"2024-04-26T18:08:39.074001+0000","last_active":"2024-04-26T18:08:39.073960+0000","last_peered":"2024-04-26T18:08:39.073960+0000","last_clean":"2024-04-26T18:08:39.073960+0000","last_became_active":"2024-04-26T17:58:13.499209+0000","last_became_peered":"2024-04-26T17:58:13.499209+0000","last_unstale":"2024-04-26T18:08:39.073960+0000","last_undegraded":"2024-04-26T18:08:39.073960+0000","last_fullsized":"2024-04-26T18:08:39.073960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:39.073851+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:39.073851+0000","last_clean_scrub_stamp":"2024-04-26T18:08:39.073851+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:43.431262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.12257064600000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"36'650","reported_seq":2781,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.620043+0000","last_change":"2024-04-26T18:08:48.620107+0000","last_active":"2024-04-26T18:08:48.620043+0000","last_peered":"2024-04-26T18:08:48.620043+0000","last_clean":"2024-04-26T18:08:48.620043+0000","last_became_active":"2024-04-26T17:58:17.534582+0000","last_became_peered":"2024-04-26T17:58:17.534582+0000","last_unstale":"2024-04-26T18:08:48.620043+0000","last_undegraded":"2024-04-26T18:08:48.620043+0000","last_fullsized":"2024-04-26T18:08:48.620043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'650","last_scrub_stamp":"2024-04-26T18:08:48.619906+0000","last_deep_scrub":"36'650","last_deep_scrub_stamp":"2024-04-26T18:08:48.619906+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.619906+0000","objects_scrubbed":319,"log_size":650,"log_dups_size":0,"ondisk_log_size":650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:38.433494+0000","scrub_duration":123,"objects_trimmed":0,"snaptrim_duration":0.14130918100000001,"stat_sum":{"num_bytes":20959894,"num_objects":319,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":319,"num_whiteouts":0,"num_read":47,"num_read_kb":20522,"num_write":649,"num_write_kb":53570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"36'107","reported_seq":2186,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:45.185265+0000","last_change":"2024-04-26T18:08:45.185295+0000","last_active":"2024-04-26T18:08:45.185265+0000","last_peered":"2024-04-26T18:08:45.185265+0000","last_clean":"2024-04-26T18:08:45.185265+0000","last_became_active":"2024-04-26T17:58:13.493381+0000","last_became_peered":"2024-04-26T17:58:13.493381+0000","last_unstale":"2024-04-26T18:08:45.185265+0000","last_undegraded":"2024-04-26T18:08:45.185265+0000","last_fullsized":"2024-04-26T18:08:45.185265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'107","last_scrub_stamp":"2024-04-26T18:08:45.185165+0000","last_deep_scrub":"36'107","last_deep_scrub_stamp":"2024-04-26T18:08:45.185165+0000","last_clean_scrub_stamp":"2024-04-26T18:08:45.185165+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:53:33.979510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100375987,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"36'110","reported_seq":2189,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.451349+0000","last_change":"2024-04-26T18:08:38.451349+0000","last_active":"2024-04-26T18:08:38.451349+0000","last_peered":"2024-04-26T18:08:38.451349+0000","last_clean":"2024-04-26T18:08:38.451349+0000","last_became_active":"2024-04-26T17:58:13.487443+0000","last_became_peered":"2024-04-26T17:58:13.487443+0000","last_unstale":"2024-04-26T18:08:38.451349+0000","last_undegraded":"2024-04-26T18:08:38.451349+0000","last_fullsized":"2024-04-26T18:08:38.451349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'110","last_scrub_stamp":"2024-04-26T18:08:38.451211+0000","last_deep_scrub":"36'110","last_deep_scrub_stamp":"2024-04-26T18:08:38.451211+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.451211+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:42.122218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.037185577999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"36'102","reported_seq":2180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:47.366485+0000","last_change":"2024-04-26T18:08:47.366504+0000","last_active":"2024-04-26T18:08:47.366485+0000","last_peered":"2024-04-26T18:08:47.366485+0000","last_clean":"2024-04-26T18:08:47.366485+0000","last_became_active":"2024-04-26T17:58:13.503904+0000","last_became_peered":"2024-04-26T17:58:13.503904+0000","last_unstale":"2024-04-26T18:08:47.366485+0000","last_undegraded":"2024-04-26T18:08:47.366485+0000","last_fullsized":"2024-04-26T18:08:47.366485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-26T18:08:47.366409+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-26T18:08:47.366409+0000","last_clean_scrub_stamp":"2024-04-26T18:08:47.366409+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:38:36.531315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.103012135,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"36'99","reported_seq":2178,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:38.326641+0000","last_change":"2024-04-26T18:08:38.326641+0000","last_active":"2024-04-26T18:08:38.326641+0000","last_peered":"2024-04-26T18:08:38.326641+0000","last_clean":"2024-04-26T18:08:38.326641+0000","last_became_active":"2024-04-26T17:58:13.495462+0000","last_became_peered":"2024-04-26T17:58:13.495462+0000","last_unstale":"2024-04-26T18:08:38.326641+0000","last_undegraded":"2024-04-26T18:08:38.326641+0000","last_fullsized":"2024-04-26T18:08:38.326641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-04-26T18:08:38.326511+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-04-26T18:08:38.326511+0000","last_clean_scrub_stamp":"2024-04-26T18:08:38.326511+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:50:51.091796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.118753491,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"36'79","reported_seq":2158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.528708+0000","last_change":"2024-04-26T18:08:41.528708+0000","last_active":"2024-04-26T18:08:41.528708+0000","last_peered":"2024-04-26T18:08:41.528708+0000","last_clean":"2024-04-26T18:08:41.528708+0000","last_became_active":"2024-04-26T17:58:13.492602+0000","last_became_peered":"2024-04-26T17:58:13.492602+0000","last_unstale":"2024-04-26T18:08:41.528708+0000","last_undegraded":"2024-04-26T18:08:41.528708+0000","last_fullsized":"2024-04-26T18:08:41.528708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'79","last_scrub_stamp":"2024-04-26T18:08:41.528593+0000","last_deep_scrub":"36'79","last_deep_scrub_stamp":"2024-04-26T18:08:41.528593+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.528593+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T00:11:09.533070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.141682378,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"36'74","reported_seq":2153,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.922879+0000","last_change":"2024-04-26T18:08:42.922879+0000","last_active":"2024-04-26T18:08:42.922879+0000","last_peered":"2024-04-26T18:08:42.922879+0000","last_clean":"2024-04-26T18:08:42.922879+0000","last_became_active":"2024-04-26T17:58:13.504860+0000","last_became_peered":"2024-04-26T17:58:13.504860+0000","last_unstale":"2024-04-26T18:08:42.922879+0000","last_undegraded":"2024-04-26T18:08:42.922879+0000","last_fullsized":"2024-04-26T18:08:42.922879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-26T18:08:42.922749+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-26T18:08:42.922749+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.922749+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T01:46:41.128014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060290038999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"36'109","reported_seq":2188,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.165384+0000","last_change":"2024-04-26T18:08:46.165384+0000","last_active":"2024-04-26T18:08:46.165384+0000","last_peered":"2024-04-26T18:08:46.165384+0000","last_clean":"2024-04-26T18:08:46.165384+0000","last_became_active":"2024-04-26T17:58:13.494929+0000","last_became_peered":"2024-04-26T17:58:13.494929+0000","last_unstale":"2024-04-26T18:08:46.165384+0000","last_undegraded":"2024-04-26T18:08:46.165384+0000","last_fullsized":"2024-04-26T18:08:46.165384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'109","last_scrub_stamp":"2024-04-26T18:08:46.165287+0000","last_deep_scrub":"36'109","last_deep_scrub_stamp":"2024-04-26T18:08:46.165287+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.165287+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:45:53.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100537793,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"36'83","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.489725+0000","last_change":"2024-04-26T18:08:37.489725+0000","last_active":"2024-04-26T18:08:37.489725+0000","last_peered":"2024-04-26T18:08:37.489725+0000","last_clean":"2024-04-26T18:08:37.489725+0000","last_became_active":"2024-04-26T17:58:13.498439+0000","last_became_peered":"2024-04-26T17:58:13.498439+0000","last_unstale":"2024-04-26T18:08:37.489725+0000","last_undegraded":"2024-04-26T18:08:37.489725+0000","last_fullsized":"2024-04-26T18:08:37.489725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'83","last_scrub_stamp":"2024-04-26T18:08:37.489600+0000","last_deep_scrub":"36'83","last_deep_scrub_stamp":"2024-04-26T18:08:37.489600+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.489600+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:51:21.970320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.14904434,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"36'91","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.338650+0000","last_change":"2024-04-26T18:08:43.338650+0000","last_active":"2024-04-26T18:08:43.338650+0000","last_peered":"2024-04-26T18:08:43.338650+0000","last_clean":"2024-04-26T18:08:43.338650+0000","last_became_active":"2024-04-26T17:58:13.497684+0000","last_became_peered":"2024-04-26T17:58:13.497684+0000","last_unstale":"2024-04-26T18:08:43.338650+0000","last_undegraded":"2024-04-26T18:08:43.338650+0000","last_fullsized":"2024-04-26T18:08:43.338650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:43.338554+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:43.338554+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.338554+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:49:25.048151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10316940500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:34.459478+0000","last_change":"2024-04-26T18:08:34.459533+0000","last_active":"2024-04-26T18:08:34.459478+0000","last_peered":"2024-04-26T18:08:34.459478+0000","last_clean":"2024-04-26T18:08:34.459478+0000","last_became_active":"2024-04-26T17:58:13.499333+0000","last_became_peered":"2024-04-26T17:58:13.499333+0000","last_unstale":"2024-04-26T18:08:34.459478+0000","last_undegraded":"2024-04-26T18:08:34.459478+0000","last_fullsized":"2024-04-26T18:08:34.459478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:34.459396+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:34.459396+0000","last_clean_scrub_stamp":"2024-04-26T18:08:34.459396+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:33.197157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.14583195199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"36'95","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:42.445082+0000","last_change":"2024-04-26T18:08:42.445104+0000","last_active":"2024-04-26T18:08:42.445082+0000","last_peered":"2024-04-26T18:08:42.445082+0000","last_clean":"2024-04-26T18:08:42.445082+0000","last_became_active":"2024-04-26T17:58:55.723222+0000","last_became_peered":"2024-04-26T17:58:55.723222+0000","last_unstale":"2024-04-26T18:08:42.445082+0000","last_undegraded":"2024-04-26T18:08:42.445082+0000","last_fullsized":"2024-04-26T18:08:42.445082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'95","last_scrub_stamp":"2024-04-26T18:08:42.445016+0000","last_deep_scrub":"36'95","last_deep_scrub_stamp":"2024-04-26T18:08:42.445016+0000","last_clean_scrub_stamp":"2024-04-26T18:08:42.445016+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:35:12.913061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036259864000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"36'90","reported_seq":2168,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:32.349724+0000","last_change":"2024-04-26T18:08:32.349755+0000","last_active":"2024-04-26T18:08:32.349724+0000","last_peered":"2024-04-26T18:08:32.349724+0000","last_clean":"2024-04-26T18:08:32.349724+0000","last_became_active":"2024-04-26T17:58:13.495320+0000","last_became_peered":"2024-04-26T17:58:13.495320+0000","last_unstale":"2024-04-26T18:08:32.349724+0000","last_undegraded":"2024-04-26T18:08:32.349724+0000","last_fullsized":"2024-04-26T18:08:32.349724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:32.349651+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:32.349651+0000","last_clean_scrub_stamp":"2024-04-26T18:08:32.349651+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:48.245363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.11890200500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"36'98","reported_seq":2176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.228183+0000","last_change":"2024-04-26T18:08:44.228221+0000","last_active":"2024-04-26T18:08:44.228183+0000","last_peered":"2024-04-26T18:08:44.228183+0000","last_clean":"2024-04-26T18:08:44.228183+0000","last_became_active":"2024-04-26T17:58:13.492533+0000","last_became_peered":"2024-04-26T17:58:13.492533+0000","last_unstale":"2024-04-26T18:08:44.228183+0000","last_undegraded":"2024-04-26T18:08:44.228183+0000","last_fullsized":"2024-04-26T18:08:44.228183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'98","last_scrub_stamp":"2024-04-26T18:08:44.228097+0000","last_deep_scrub":"36'98","last_deep_scrub_stamp":"2024-04-26T18:08:44.228097+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.228097+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:27:49.180562+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.099810701000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.403372+0000","last_change":"2024-04-26T18:08:36.403411+0000","last_active":"2024-04-26T18:08:36.403372+0000","last_peered":"2024-04-26T18:08:36.403372+0000","last_clean":"2024-04-26T18:08:36.403372+0000","last_became_active":"2024-04-26T17:58:13.501380+0000","last_became_peered":"2024-04-26T17:58:13.501380+0000","last_unstale":"2024-04-26T18:08:36.403372+0000","last_undegraded":"2024-04-26T18:08:36.403372+0000","last_fullsized":"2024-04-26T18:08:36.403372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:36.403267+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:36.403267+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.403267+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:02:17.707113+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.066407796000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"36'88","reported_seq":2166,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.486854+0000","last_change":"2024-04-26T18:08:37.486882+0000","last_active":"2024-04-26T18:08:37.486854+0000","last_peered":"2024-04-26T18:08:37.486854+0000","last_clean":"2024-04-26T18:08:37.486854+0000","last_became_active":"2024-04-26T17:58:13.486028+0000","last_became_peered":"2024-04-26T17:58:13.486028+0000","last_unstale":"2024-04-26T18:08:37.486854+0000","last_undegraded":"2024-04-26T18:08:37.486854+0000","last_fullsized":"2024-04-26T18:08:37.486854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'88","last_scrub_stamp":"2024-04-26T18:08:37.486765+0000","last_deep_scrub":"36'88","last_deep_scrub_stamp":"2024-04-26T18:08:37.486765+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.486765+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:26:44.560768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.039049671000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"36'94","reported_seq":2171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:46.378735+0000","last_change":"2024-04-26T18:08:46.378758+0000","last_active":"2024-04-26T18:08:46.378735+0000","last_peered":"2024-04-26T18:08:46.378735+0000","last_clean":"2024-04-26T18:08:46.378735+0000","last_became_active":"2024-04-26T17:58:13.503098+0000","last_became_peered":"2024-04-26T17:58:13.503098+0000","last_unstale":"2024-04-26T18:08:46.378735+0000","last_undegraded":"2024-04-26T18:08:46.378735+0000","last_fullsized":"2024-04-26T18:08:46.378735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'94","last_scrub_stamp":"2024-04-26T18:08:46.378648+0000","last_deep_scrub":"36'94","last_deep_scrub_stamp":"2024-04-26T18:08:46.378648+0000","last_clean_scrub_stamp":"2024-04-26T18:08:46.378648+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:34:21.678978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.100805099,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"36'97","reported_seq":2174,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.334757+0000","last_change":"2024-04-26T18:08:40.334780+0000","last_active":"2024-04-26T18:08:40.334757+0000","last_peered":"2024-04-26T18:08:40.334757+0000","last_clean":"2024-04-26T18:08:40.334757+0000","last_became_active":"2024-04-26T17:58:13.492325+0000","last_became_peered":"2024-04-26T17:58:13.492325+0000","last_unstale":"2024-04-26T18:08:40.334757+0000","last_undegraded":"2024-04-26T18:08:40.334757+0000","last_fullsized":"2024-04-26T18:08:40.334757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'97","last_scrub_stamp":"2024-04-26T18:08:40.334684+0000","last_deep_scrub":"36'97","last_deep_scrub_stamp":"2024-04-26T18:08:40.334684+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.334684+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:31:30.453975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.10180945299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"36'85","reported_seq":2163,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:33.899172+0000","last_change":"2024-04-26T18:08:33.899194+0000","last_active":"2024-04-26T18:08:33.899172+0000","last_peered":"2024-04-26T18:08:33.899172+0000","last_clean":"2024-04-26T18:08:33.899172+0000","last_became_active":"2024-04-26T17:58:13.499580+0000","last_became_peered":"2024-04-26T17:58:13.499580+0000","last_unstale":"2024-04-26T18:08:33.899172+0000","last_undegraded":"2024-04-26T18:08:33.899172+0000","last_fullsized":"2024-04-26T18:08:33.899172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'85","last_scrub_stamp":"2024-04-26T18:08:33.899105+0000","last_deep_scrub":"36'85","last_deep_scrub_stamp":"2024-04-26T18:08:33.899105+0000","last_clean_scrub_stamp":"2024-04-26T18:08:33.899105+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:58.096182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060891220000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'92","reported_seq":2170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:43.392865+0000","last_change":"2024-04-26T18:08:43.392888+0000","last_active":"2024-04-26T18:08:43.392865+0000","last_peered":"2024-04-26T18:08:43.392865+0000","last_clean":"2024-04-26T18:08:43.392865+0000","last_became_active":"2024-04-26T17:58:13.499605+0000","last_became_peered":"2024-04-26T17:58:13.499605+0000","last_unstale":"2024-04-26T18:08:43.392865+0000","last_undegraded":"2024-04-26T18:08:43.392865+0000","last_fullsized":"2024-04-26T18:08:43.392865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:43.392793+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:43.392793+0000","last_clean_scrub_stamp":"2024-04-26T18:08:43.392793+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:46:35.560219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.111257298,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"36'81","reported_seq":2159,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.557341+0000","last_change":"2024-04-26T18:08:44.557362+0000","last_active":"2024-04-26T18:08:44.557341+0000","last_peered":"2024-04-26T18:08:44.557341+0000","last_clean":"2024-04-26T18:08:44.557341+0000","last_became_active":"2024-04-26T17:58:13.496503+0000","last_became_peered":"2024-04-26T17:58:13.496503+0000","last_unstale":"2024-04-26T18:08:44.557341+0000","last_undegraded":"2024-04-26T18:08:44.557341+0000","last_fullsized":"2024-04-26T18:08:44.557341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'81","last_scrub_stamp":"2024-04-26T18:08:44.557259+0000","last_deep_scrub":"36'81","last_deep_scrub_stamp":"2024-04-26T18:08:44.557259+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.557259+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T02:51:21.191378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13708933400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"36'76","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:37.066154+0000","last_change":"2024-04-26T18:08:37.066177+0000","last_active":"2024-04-26T18:08:37.066154+0000","last_peered":"2024-04-26T18:08:37.066154+0000","last_clean":"2024-04-26T18:08:37.066154+0000","last_became_active":"2024-04-26T17:58:13.496015+0000","last_became_peered":"2024-04-26T17:58:13.496015+0000","last_unstale":"2024-04-26T18:08:37.066154+0000","last_undegraded":"2024-04-26T18:08:37.066154+0000","last_fullsized":"2024-04-26T18:08:37.066154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'76","last_scrub_stamp":"2024-04-26T18:08:37.066082+0000","last_deep_scrub":"36'76","last_deep_scrub_stamp":"2024-04-26T18:08:37.066082+0000","last_clean_scrub_stamp":"2024-04-26T18:08:37.066082+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:19:21.056477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.122469732,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"36'91","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:41.173555+0000","last_change":"2024-04-26T18:08:41.173590+0000","last_active":"2024-04-26T18:08:41.173555+0000","last_peered":"2024-04-26T18:08:41.173555+0000","last_clean":"2024-04-26T18:08:41.173555+0000","last_became_active":"2024-04-26T17:58:13.489579+0000","last_became_peered":"2024-04-26T17:58:13.489579+0000","last_unstale":"2024-04-26T18:08:41.173555+0000","last_undegraded":"2024-04-26T18:08:41.173555+0000","last_fullsized":"2024-04-26T18:08:41.173555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'91","last_scrub_stamp":"2024-04-26T18:08:41.173486+0000","last_deep_scrub":"36'91","last_deep_scrub_stamp":"2024-04-26T18:08:41.173486+0000","last_clean_scrub_stamp":"2024-04-26T18:08:41.173486+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:35:20.856659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099606834000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"36'99","reported_seq":2177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.124050+0000","last_change":"2024-04-26T18:08:40.124071+0000","last_active":"2024-04-26T18:08:40.124050+0000","last_peered":"2024-04-26T18:08:40.124050+0000","last_clean":"2024-04-26T18:08:40.124050+0000","last_became_active":"2024-04-26T17:58:13.489524+0000","last_became_peered":"2024-04-26T17:58:13.489524+0000","last_unstale":"2024-04-26T18:08:40.124050+0000","last_undegraded":"2024-04-26T18:08:40.124050+0000","last_fullsized":"2024-04-26T18:08:40.124050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'99","last_scrub_stamp":"2024-04-26T18:08:40.123979+0000","last_deep_scrub":"36'99","last_deep_scrub_stamp":"2024-04-26T18:08:40.123979+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.123979+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:50:59.603311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.099888910999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"36'84","reported_seq":2162,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:51.639986+0000","last_change":"2024-04-26T18:08:51.640013+0000","last_active":"2024-04-26T18:08:51.639986+0000","last_peered":"2024-04-26T18:08:51.639986+0000","last_clean":"2024-04-26T18:08:51.639986+0000","last_became_active":"2024-04-26T17:58:13.505564+0000","last_became_peered":"2024-04-26T17:58:13.505564+0000","last_unstale":"2024-04-26T18:08:51.639986+0000","last_undegraded":"2024-04-26T18:08:51.639986+0000","last_fullsized":"2024-04-26T18:08:51.639986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'84","last_scrub_stamp":"2024-04-26T18:08:51.639914+0000","last_deep_scrub":"36'84","last_deep_scrub_stamp":"2024-04-26T18:08:51.639914+0000","last_clean_scrub_stamp":"2024-04-26T18:08:51.639914+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T04:25:44.175665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.064315782000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"36'74","reported_seq":2152,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:36.488628+0000","last_change":"2024-04-26T18:08:36.488653+0000","last_active":"2024-04-26T18:08:36.488628+0000","last_peered":"2024-04-26T18:08:36.488628+0000","last_clean":"2024-04-26T18:08:36.488628+0000","last_became_active":"2024-04-26T17:58:13.501509+0000","last_became_peered":"2024-04-26T17:58:13.501509+0000","last_unstale":"2024-04-26T18:08:36.488628+0000","last_undegraded":"2024-04-26T18:08:36.488628+0000","last_fullsized":"2024-04-26T18:08:36.488628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'74","last_scrub_stamp":"2024-04-26T18:08:36.488545+0000","last_deep_scrub":"36'74","last_deep_scrub_stamp":"2024-04-26T18:08:36.488545+0000","last_clean_scrub_stamp":"2024-04-26T18:08:36.488545+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T23:18:52.627228+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.140824224,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"36'104","reported_seq":2182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.661854+0000","last_change":"2024-04-26T18:08:48.661874+0000","last_active":"2024-04-26T18:08:48.661854+0000","last_peered":"2024-04-26T18:08:48.661854+0000","last_clean":"2024-04-26T18:08:48.661854+0000","last_became_active":"2024-04-26T17:58:13.504706+0000","last_became_peered":"2024-04-26T17:58:13.504706+0000","last_unstale":"2024-04-26T18:08:48.661854+0000","last_undegraded":"2024-04-26T18:08:48.661854+0000","last_fullsized":"2024-04-26T18:08:48.661854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'104","last_scrub_stamp":"2024-04-26T18:08:48.661784+0000","last_deep_scrub":"36'104","last_deep_scrub_stamp":"2024-04-26T18:08:48.661784+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.661784+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:36:10.058873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.070770340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"36'92","reported_seq":2156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:40.422026+0000","last_change":"2024-04-26T18:08:40.422026+0000","last_active":"2024-04-26T18:08:40.422026+0000","last_peered":"2024-04-26T18:08:40.422026+0000","last_clean":"2024-04-26T18:08:40.422026+0000","last_became_active":"2024-04-26T17:58:55.639271+0000","last_became_peered":"2024-04-26T17:58:55.639271+0000","last_unstale":"2024-04-26T18:08:40.422026+0000","last_undegraded":"2024-04-26T18:08:40.422026+0000","last_fullsized":"2024-04-26T18:08:40.422026+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'92","last_scrub_stamp":"2024-04-26T18:08:40.421918+0000","last_deep_scrub":"36'92","last_deep_scrub_stamp":"2024-04-26T18:08:40.421918+0000","last_clean_scrub_stamp":"2024-04-26T18:08:40.421918+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-28T03:57:47.762254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035797588999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"36'102","reported_seq":2180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:44.620645+0000","last_change":"2024-04-26T18:08:44.620667+0000","last_active":"2024-04-26T18:08:44.620645+0000","last_peered":"2024-04-26T18:08:44.620645+0000","last_clean":"2024-04-26T18:08:44.620645+0000","last_became_active":"2024-04-26T17:58:13.500719+0000","last_became_peered":"2024-04-26T17:58:13.500719+0000","last_unstale":"2024-04-26T18:08:44.620645+0000","last_undegraded":"2024-04-26T18:08:44.620645+0000","last_fullsized":"2024-04-26T18:08:44.620645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'102","last_scrub_stamp":"2024-04-26T18:08:44.620580+0000","last_deep_scrub":"36'102","last_deep_scrub_stamp":"2024-04-26T18:08:44.620580+0000","last_clean_scrub_stamp":"2024-04-26T18:08:44.620580+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:01:46.700611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.067520009000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"36'76","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:48.323527+0000","last_change":"2024-04-26T18:08:48.323568+0000","last_active":"2024-04-26T18:08:48.323527+0000","last_peered":"2024-04-26T18:08:48.323527+0000","last_clean":"2024-04-26T18:08:48.323527+0000","last_became_active":"2024-04-26T17:58:13.504288+0000","last_became_peered":"2024-04-26T17:58:13.504288+0000","last_unstale":"2024-04-26T18:08:48.323527+0000","last_undegraded":"2024-04-26T18:08:48.323527+0000","last_fullsized":"2024-04-26T18:08:48.323527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'76","last_scrub_stamp":"2024-04-26T18:08:48.323445+0000","last_deep_scrub":"36'76","last_deep_scrub_stamp":"2024-04-26T18:08:48.323445+0000","last_clean_scrub_stamp":"2024-04-26T18:08:48.323445+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:33:24.857135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.101073922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"36'90","reported_seq":2169,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:35.376829+0000","last_change":"2024-04-26T18:08:35.376829+0000","last_active":"2024-04-26T18:08:35.376829+0000","last_peered":"2024-04-26T18:08:35.376829+0000","last_clean":"2024-04-26T18:08:35.376829+0000","last_became_active":"2024-04-26T17:58:13.489914+0000","last_became_peered":"2024-04-26T17:58:13.489914+0000","last_unstale":"2024-04-26T18:08:35.376829+0000","last_undegraded":"2024-04-26T18:08:35.376829+0000","last_fullsized":"2024-04-26T18:08:35.376829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'90","last_scrub_stamp":"2024-04-26T18:08:35.376736+0000","last_deep_scrub":"36'90","last_deep_scrub_stamp":"2024-04-26T18:08:35.376736+0000","last_clean_scrub_stamp":"2024-04-26T18:08:35.376736+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:50:46.679519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.13223516900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"36'75","reported_seq":2154,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:32.864655+0000","last_change":"2024-04-26T18:08:32.864655+0000","last_active":"2024-04-26T18:08:32.864655+0000","last_peered":"2024-04-26T18:08:32.864655+0000","last_clean":"2024-04-26T18:08:32.864655+0000","last_became_active":"2024-04-26T17:58:13.502565+0000","last_became_peered":"2024-04-26T17:58:13.502565+0000","last_unstale":"2024-04-26T18:08:32.864655+0000","last_undegraded":"2024-04-26T18:08:32.864655+0000","last_fullsized":"2024-04-26T18:08:32.864655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-04-26T18:08:32.864504+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-04-26T18:08:32.864504+0000","last_clean_scrub_stamp":"2024-04-26T18:08:32.864504+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:17.483171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.061784922999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"36'86","reported_seq":2165,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-04-26T18:08:52.643083+0000","last_change":"2024-04-26T18:08:52.643118+0000","last_active":"2024-04-26T18:08:52.643083+0000","last_peered":"2024-04-26T18:08:52.643083+0000","last_clean":"2024-04-26T18:08:52.643083+0000","last_became_active":"2024-04-26T17:58:13.506611+0000","last_became_peered":"2024-04-26T17:58:13.506611+0000","last_unstale":"2024-04-26T18:08:52.643083+0000","last_undegraded":"2024-04-26T18:08:52.643083+0000","last_fullsized":"2024-04-26T18:08:52.643083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'86","last_scrub_stamp":"2024-04-26T18:08:52.642987+0000","last_deep_scrub":"36'86","last_deep_scrub_stamp":"2024-04-26T18:08:52.642987+0000","last_clean_scrub_stamp":"2024-04-26T18:08:52.642987+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:24.564652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.063527101000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":949747224,"num_objects":10636,"num_object_clones":0,"num_object_copies":42544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10636,"num_whiteouts":0,"num_read":1250,"num_read_kb":386251,"num_write":21453,"num_write_kb":1544191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2021097472,"data_stored":2021097472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21482,"ondisk_log_size":21482,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5776,"ondisk_log_size":5776,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":238719230,"num_objects":152,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":120,"num_read_kb":647,"num_write":8828,"num_write_kb":242045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":79,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":665880,"num_omap_keys":1113,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":477495296,"data_stored":477438460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8574,"ondisk_log_size":8574,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574985,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374264,"kb_used_data":288944,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":93997576,"statfs":{"total":96636764160,"available":96253517824,"internally_reserved":0,"allocated":295878656,"data_stored":295659565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":87357898},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":450380,"kb_used_data":338756,"kb_used_omap":1,"kb_used_meta":111614,"kb_avail":93921460,"statfs":{"total":96636764160,"available":96175575040,"internally_reserved":0,"allocated":346886144,"data_stored":346666437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":114293190},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574986,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":345068,"kb_used_data":263908,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94026772,"statfs":{"total":96636764160,"available":96283414528,"internally_reserved":0,"allocated":270241792,"data_stored":270025761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574988,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":417436,"kb_used_data":318228,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":93954404,"statfs":{"total":96636764160,"available":96209309696,"internally_reserved":0,"allocated":325865472,"data_stored":325641123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":527448,"kb_used_data":397712,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":93844392,"statfs":{"total":96636764160,"available":96096657408,"internally_reserved":0,"allocated":407257088,"data_stored":407036489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":132839879},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":274140,"kb_used_data":198548,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94097700,"statfs":{"total":96636764160,"available":96356044800,"internally_reserved":0,"allocated":203313152,"data_stored":203100073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":490184,"kb_used_data":378496,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":93881656,"statfs":{"total":96636764160,"available":96134815744,"internally_reserved":0,"allocated":387579904,"data_stored":387359847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574986,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353376,"kb_used_data":259736,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94018464,"statfs":{"total":96636764160,"available":96274907136,"internally_reserved":0,"allocated":265969664,"data_stored":265742437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":67117056,"data_stored":67109024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21549056,"data_stored":21548002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50917376,"data_stored":50908802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":66187264,"data_stored":66174940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":67112960,"data_stored":67108954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":74571776,"data_stored":74564094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79695872,"data_stored":79692358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":214630400,"data_stored":214630400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":320061440,"data_stored":320061440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":181362688,"data_stored":181362688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":355938304,"data_stored":355938304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":259276800,"data_stored":259276800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":202727424,"data_stored":202727424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":271912960,"data_stored":271912960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":215187456,"data_stored":215187456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T18:09:16.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T18:09:16.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.479+0000 7f37d9339640 1 Processor -- start 2024-04-26T18:09:16.479 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 -- start start 2024-04-26T18:09:16.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37d41560e0 0x7f37d40cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 0x7f37d40c8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37d40c8b60 0x7f37d415d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f37d40c8fb0 con 0x7f37d40c8b60 2024-04-26T18:09:16.482 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f37d40731e0 con 0x7f37d41560e0 2024-04-26T18:09:16.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d9339640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37d40734a0 con 0x7f37d40ce0f0 2024-04-26T18:09:16.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.480+0000 7f37d37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37d40c8b60 0x7f37d415d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37d40c8b60 0x7f37d415d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35984/0 (socket says 172.21.15.12:35984) 2024-04-26T18:09:16.483 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 -- 172.21.15.12:0/1909001326 learned_addr learned my addr 172.21.15.12:0/1909001326 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:16.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d2ffd640 1 --2- 172.21.15.12:0/1909001326 >> v2:172.21.15.100:3300/0 conn(0x7f37d41560e0 0x7f37d40cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d27fc640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 0x7f37d40c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 -- 172.21.15.12:0/1909001326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 msgr2=0x7f37d40c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 0x7f37d40c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.484 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 -- 172.21.15.12:0/1909001326 >> v2:172.21.15.100:3300/0 conn(0x7f37d41560e0 msgr2=0x7f37d40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 --2- 172.21.15.12:0/1909001326 >> v2:172.21.15.100:3300/0 conn(0x7f37d41560e0 0x7f37d40cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d37fe640 1 -- 172.21.15.12:0/1909001326 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d4073780 con 0x7f37d40c8b60 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.481+0000 7f37d27fc640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 0x7f37d40c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d37fe640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d415d550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f37d4074b30 tx=0x7f37c402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588e5609ef2d5e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d1ffb640 1 -- 172.21.15.12:0/1909001326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c4036070 con 0x7f37d40c8b60 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d1ffb640 1 -- 172.21.15.12:0/1909001326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37c4031600 con 0x7f37d40c8b60 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d1ffb640 1 -- 172.21.15.12:0/1909001326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37c40319d0 con 0x7f37d40c8b60 2024-04-26T18:09:16.485 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 -- 172.21.15.12:0/1909001326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 msgr2=0x7f37d415d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d415d550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f37d4074b30 tx=0x7f37c402a730 comp rx=0 tx=0).stop 2024-04-26T18:09:16.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 -- 172.21.15.12:0/1909001326 shutdown_connections 2024-04-26T18:09:16.486 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d415d550 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 --2- 172.21.15.12:0/1909001326 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d40ce0f0 0x7f37d40c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 --2- 172.21.15.12:0/1909001326 >> v2:172.21.15.100:3300/0 conn(0x7f37d41560e0 0x7f37d40cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 -- 172.21.15.12:0/1909001326 >> 172.21.15.12:0/1909001326 conn(0x7f37d406e500 msgr2=0x7f37d406e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 -- 172.21.15.12:0/1909001326 shutdown_connections 2024-04-26T18:09:16.487 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.482+0000 7f37d9339640 1 -- 172.21.15.12:0/1909001326 wait complete. 2024-04-26T18:09:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 Processor -- start 2024-04-26T18:09:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 -- start start 2024-04-26T18:09:16.491 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37d40ce0f0 0x7f37d414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d41560e0 0x7f37d41f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f37d4074020 con 0x7f37d40c8b60 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f37d4073d40 con 0x7f37d40ce0f0 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d9339640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f37d415ca40 con 0x7f37d41560e0 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d2ffd640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36000/0 (socket says 172.21.15.12:36000) 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.484+0000 7f37d2ffd640 1 -- 172.21.15.12:0/2678707412 learned_addr learned my addr 172.21.15.12:0/2678707412 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:16.492 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d27fc640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37d40ce0f0 0x7f37d414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d37fe640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d41560e0 0x7f37d41f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 -- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d41560e0 msgr2=0x7f37d41f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d41560e0 0x7f37d41f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 -- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37d40ce0f0 msgr2=0x7f37d414d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37d40ce0f0 0x7f37d414d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 -- 172.21.15.12:0/2678707412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37d41f1e10 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d2ffd640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e9e0 tx=0x7f37cc00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc017070 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37cc00c9d0 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37d41f20b0 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc00cdc0 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.485+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37d414c6f0 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.486+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37d4076d20 con 0x7f37d40c8b60 2024-04-26T18:09:16.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.487+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37cc01a070 con 0x7f37d40c8b60 2024-04-26T18:09:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.487+0000 7f37cb7fe640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 0x7f37b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.487+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f37cc08bfa0 con 0x7f37d40c8b60 2024-04-26T18:09:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.488+0000 7f37d27fc640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 0x7f37b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.488+0000 7f37d27fc640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 0x7f37b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006fd0 tx=0x7f37bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.492+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37cc05a020 con 0x7f37d40c8b60 2024-04-26T18:09:16.676 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.677+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f37d40c7790 con 0x7f37d40c8b60 2024-04-26T18:09:16.679 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.680+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f37cc059920 con 0x7f37d40c8b60 2024-04-26T18:09:16.680 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.681+0000 7f37cb7fe640 1 -- 172.21.15.12:0/2678707412 <== mon.0 v2:172.21.15.12:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f37cc05dcd0 con 0x7f37d40c8b60 2024-04-26T18:09:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.682+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 msgr2=0x7f37b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.682+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 0x7f37b406edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006fd0 tx=0x7f37bc008040 comp rx=0 tx=0).stop 2024-04-26T18:09:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.682+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 msgr2=0x7f37d40ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.682 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00e9e0 tx=0x7f37cc00eea0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 shutdown_connections 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f37b406c8f0 0x7f37b406edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f37d41560e0 0x7f37d41f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37d40ce0f0 0x7f37d414d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 --2- 172.21.15.12:0/2678707412 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37d40c8b60 0x7f37d40ccdc0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 >> 172.21.15.12:0/2678707412 conn(0x7f37d406e500 msgr2=0x7f37d4070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.683 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 shutdown_connections 2024-04-26T18:09:16.684 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.683+0000 7f37d9339640 1 -- 172.21.15.12:0/2678707412 wait complete. 2024-04-26T18:09:16.693 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T18:09:16.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:09:16.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.794+0000 7f63e8f6a640 1 Processor -- start 2024-04-26T18:09:16.798 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.794+0000 7f63e8f6a640 1 -- start start 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e8f6a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63e4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e8f6a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40c95b0 con 0x7f63e40cae30 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e8f6a640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e40c9820 con 0x7f63e40c8a30 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e8f6a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f63e4071b90 con 0x7f63e40cb210 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e259c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f63e40cae30 0x7f63e4071480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41080/0 (socket says 172.21.15.12:41080) 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e259c640 1 -- 172.21.15.12:0/2145802416 learned_addr learned my addr 172.21.15.12:0/2145802416 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:09:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63e4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619541527 0 0) 0x7f63e40c95b0 con 0x7f63e40cae30 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63d0003520 con 0x7f63e40cae30 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 989801129 0 0) 0x7f63d0003520 con 0x7f63e40cae30 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 msgr2=0x7f63e4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63e4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.795+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 >> v1:172.21.15.100:6789/0 conn(0x7f63e40c8a30 legacy=0x7f63e4073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e40c9b00 con 0x7f63e40cae30 2024-04-26T18:09:16.800 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f63d4001670 con 0x7f63e40cae30 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 >> v1:172.21.15.12:6789/0 conn(0x7f63e40cae30 legacy=0x7f63e4071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63d00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d0004d40 0x7f63d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4071b90 con 0x7f63d0003f20 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63d000ba20 con 0x7f63d0004d40 2024-04-26T18:09:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f63d000bc20 con 0x7f63e40cb210 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e259c640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63d00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63e2d9d640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d0004d40 0x7f63d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 -- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 msgr2=0x7f63d00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e40cb210 0x7f63d00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 -- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d0004d40 msgr2=0x7f63d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63d0004d40 0x7f63d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.796+0000 7f63dbfff640 1 -- 172.21.15.12:0/2145802416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d0003520 con 0x7f63d0003f20 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63d0004800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009ac0 tx=0x7f63d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481cc09a8ee00cba server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc036070 con 0x7f63d0003f20 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63cc031400 con 0x7f63d0003f20 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e1d9b640 1 -- 172.21.15.12:0/2145802416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63cc009690 con 0x7f63d0003f20 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2145802416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 msgr2=0x7f63d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2145802416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63d0004800 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009ac0 tx=0x7f63d0005830 comp rx=0 tx=0).stop 2024-04-26T18:09:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.797+0000 7f63e2d9d640 1 -- 172.21.15.12:0/2145802416 reap_dead start 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.798+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2145802416 shutdown_connections 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.798+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2145802416 >> 172.21.15.12:0/2145802416 conn(0x7f63e4068090 msgr2=0x7f63e4068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.798+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2145802416 shutdown_connections 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.798+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2145802416 wait complete. 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.799+0000 7f63e8f6a640 1 Processor -- start 2024-04-26T18:09:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.799+0000 7f63e8f6a640 1 -- start start 2024-04-26T18:09:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e41560e0 0x7f63e41f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63e41f32b0 0x7f63e41529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4070f60 con 0x7f63d0003f20 2024-04-26T18:09:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f63e4070d10 con 0x7f63e41f32b0 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f63e415f340 con 0x7f63e41560e0 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36026/0 (socket says 172.21.15.12:36026) 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 -- 172.21.15.12:0/2856338390 learned_addr learned my addr 172.21.15.12:0/2856338390 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e41560e0 0x7f63e41f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e2d9d640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63e41f32b0 0x7f63e41529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 -- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e41560e0 msgr2=0x7f63e41f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e41560e0 0x7f63e41f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 -- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63e41f32b0 msgr2=0x7f63e41529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63e41f32b0 0x7f63e41529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 -- 172.21.15.12:0/2856338390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e4157d60 con 0x7f63d0003f20 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e259c640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f63d40072f0 tx=0x7f63d40077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d401a070 con 0x7f63d0003f20 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f63d400f960 con 0x7f63d0003f20 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e4158040 con 0x7f63d0003f20 2024-04-26T18:09:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.800+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d400fd70 con 0x7f63d0003f20 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.801+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e4158600 con 0x7f63d0003f20 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.802+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e40c5b60 con 0x7f63d0003f20 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.802+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63d401d070 con 0x7f63d0003f20 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.802+0000 7f63daffd640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 0x7f63c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.802+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f63d408b960 con 0x7f63d0003f20 2024-04-26T18:09:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.802+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 0x7f63c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:16.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.803+0000 7f63dbfff640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 0x7f63c406ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63cc033000 tx=0x7f63cc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:16.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:16.807+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f63e40c5b60 con 0x7f63d0003f20 2024-04-26T18:09:17.027 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.028+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63e415ac00 con 0x7f63d0003f20 2024-04-26T18:09:17.028 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.029+0000 7f63daffd640 1 -- 172.21.15.12:0/2856338390 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f63e415ac00 con 0x7f63d0003f20 2024-04-26T18:09:17.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:09:17.028 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:09:17.029 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:09:17.030 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 msgr2=0x7f63c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 0x7f63c406ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63cc033000 tx=0x7f63cc008030 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 msgr2=0x7f63e41576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f63d40072f0 tx=0x7f63d40077b0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 shutdown_connections 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63e41f32b0 0x7f63e41529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f63c406c920 0x7f63c406ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f63e41560e0 0x7f63e41f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 --2- 172.21.15.12:0/2856338390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63d0003f20 0x7f63e41576b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.031 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 >> 172.21.15.12:0/2856338390 conn(0x7f63e4068090 msgr2=0x7f63e4159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 shutdown_connections 2024-04-26T18:09:17.032 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.031+0000 7f63e8f6a640 1 -- 172.21.15.12:0/2856338390 wait complete. 2024-04-26T18:09:17.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T18:09:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.143+0000 7f28c19e7640 1 Processor -- start 2024-04-26T18:09:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.143+0000 7f28c19e7640 1 -- start start 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28c19e7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28bc15c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28c19e7640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc073a00 con 0x7f28bc15d020 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28c19e7640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28bc0c6330 con 0x7f28bc155c90 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28c19e7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc156070 con 0x7f28bc0735c0 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28bb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28bc15d020 0x7f28bc1664b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41088/0 (socket says 172.21.15.12:41088) 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28bb7fe640 1 -- 172.21.15.12:0/3335516371 learned_addr learned my addr 172.21.15.12:0/3335516371 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:09:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737230367 0 0) 0x7f28bc073a00 con 0x7f28bc15d020 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28a4003520 con 0x7f28bc15d020 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28ba7fc640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28bc15c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3494535432 0 0) 0x7f28a4003520 con 0x7f28bc15d020 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 msgr2=0x7f28bc15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28bc15c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 >> v1:172.21.15.100:6789/0 conn(0x7f28bc155c90 legacy=0x7f28bc0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc0c6610 con 0x7f28bc15d020 2024-04-26T18:09:17.147 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 41980598 0 0) 0x7f28ac0019f0 con 0x7f28bc15d020 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 >> v1:172.21.15.12:6789/0 conn(0x7f28bc15d020 legacy=0x7f28bc1664b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40039e0 0x7f28a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28a4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.144+0000 7f28b9ffb640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28a4004d40 0x7f28a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc156070 con 0x7f28a4004d40 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28a400bb00 con 0x7f28a40039e0 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f28a400bd00 con 0x7f28bc0735c0 2024-04-26T18:09:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28a4004d40 0x7f28a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28ba7fc640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28a4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28baffd640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40039e0 0x7f28a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 -- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 msgr2=0x7f28a4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28bc0735c0 0x7f28a4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 -- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40039e0 msgr2=0x7f28a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28a40039e0 0x7f28a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.145+0000 7f28bb7fe640 1 -- 172.21.15.12:0/3335516371 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a4003520 con 0x7f28a4004d40 2024-04-26T18:09:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28bb7fe640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28a4004d40 0x7f28a40051c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00a830 tx=0x7f28a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b67e24974f739f server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac00a480 con 0x7f28a4004d40 2024-04-26T18:09:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28ac02f070 con 0x7f28a4004d40 2024-04-26T18:09:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28b9ffb640 1 -- 172.21.15.12:0/3335516371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ac02bcf0 con 0x7f28a4004d40 2024-04-26T18:09:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 -- 172.21.15.12:0/3335516371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28a4004d40 msgr2=0x7f28a40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 --2- 172.21.15.12:0/3335516371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28a4004d40 0x7f28a40051c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f28ac00a830 tx=0x7f28a4005830 comp rx=0 tx=0).stop 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28bb7fe640 1 -- 172.21.15.12:0/3335516371 reap_dead start 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 -- 172.21.15.12:0/3335516371 shutdown_connections 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 -- 172.21.15.12:0/3335516371 >> 172.21.15.12:0/3335516371 conn(0x7f28bc074030 msgr2=0x7f28bc074440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 -- 172.21.15.12:0/3335516371 shutdown_connections 2024-04-26T18:09:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.146+0000 7f28c19e7640 1 -- 172.21.15.12:0/3335516371 wait complete. 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.147+0000 7f28c19e7640 1 Processor -- start 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 -- start start 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28a4004d40 0x7f28bc0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28bc0c8d60 0x7f28bc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc0c6eb0 con 0x7f28bc0cd980 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f28bc0c6bd0 con 0x7f28bc0c8d60 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28c19e7640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f28bc0c7190 con 0x7f28a4004d40 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28ba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28ba7fc640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36042/0 (socket says 172.21.15.12:36042) 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28ba7fc640 1 -- 172.21.15.12:0/1947822934 learned_addr learned my addr 172.21.15.12:0/1947822934 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28baffd640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28a4004d40 0x7f28bc0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.156 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.148+0000 7f28bb7fe640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28bc0c8d60 0x7f28bc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 -- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28a4004d40 msgr2=0x7f28bc0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28a4004d40 0x7f28bc0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 -- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28bc0c8d60 msgr2=0x7f28bc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28bc0c8d60 0x7f28bc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.157 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 -- 172.21.15.12:0/1947822934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28bc0cd030 con 0x7f28bc0cd980 2024-04-26T18:09:17.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28ba7fc640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f28b00119a0 tx=0x7f28b0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b000fa90 con 0x7f28bc0cd980 2024-04-26T18:09:17.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f28b000fc30 con 0x7f28bc0cd980 2024-04-26T18:09:17.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b0014440 con 0x7f28bc0cd980 2024-04-26T18:09:17.158 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28bc0b6390 con 0x7f28bc0cd980 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.149+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28bc0cccd0 con 0x7f28bc0cd980 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.150+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28bc076d20 con 0x7f28bc0cd980 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.151+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f28b0012040 con 0x7f28bc0cd980 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.151+0000 7f28a3fff640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 0x7f28a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.151+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f28b008c600 con 0x7f28bc0cd980 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.151+0000 7f28baffd640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 0x7f28a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.159 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.152+0000 7f28baffd640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 0x7f28a806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28b40017e0 tx=0x7f28b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.160 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.155+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f28b0019030 con 0x7f28bc0cd980 2024-04-26T18:09:17.379 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.380+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28bc0c86a0 con 0x7f28bc0cd980 2024-04-26T18:09:17.380 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.380+0000 7f28a3fff640 1 -- 172.21.15.12:0/1947822934 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6832 (secure 0 0 0) 0x7f28b0059f10 con 0x7f28bc0cd980 2024-04-26T18:09:17.380 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:09:17.380 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3381983285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3381983285},{"type":"v1","addr":"172.21.15.12:6834","nonce":3381983285}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4247,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/2440333938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2440333938},{"type":"v1","addr":"172.21.15.100:6836","nonce":2440333938}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/289206246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":289206246},{"type":"v1","addr":"172.21.15.12:6835","nonce":289206246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1904408422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1904408422},{"type":"v1","addr":"172.21.15.100:6837","nonce":1904408422}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/2621124623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":2621124623},{"type":"v1","addr":"172.21.15.12:6837","nonce":2621124623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T17:58:12.845520+0000","modified":"2024-04-26T17:58:37.922040+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6839/3743641599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3743641599},{"type":"v1","addr":"172.21.15.100:6839","nonce":3743641599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-04-26T18:09:17.380 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 9 2024-04-26T18:09:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 msgr2=0x7f28a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 0x7f28a806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28b40017e0 tx=0x7f28b4009040 comp rx=0 tx=0).stop 2024-04-26T18:09:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 msgr2=0x7f28bc1f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f28b00119a0 tx=0x7f28b0011e60 comp rx=0 tx=0).stop 2024-04-26T18:09:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 shutdown_connections 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28bc0c8d60 0x7f28bc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28bc0cd980 0x7f28bc1f5530 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f28a806c8f0 0x7f28a806edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 --2- 172.21.15.12:0/1947822934 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28a4004d40 0x7f28bc0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.382+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 >> 172.21.15.12:0/1947822934 conn(0x7f28bc074030 msgr2=0x7f28bc14ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.383+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 shutdown_connections 2024-04-26T18:09:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.383+0000 7f28c19e7640 1 -- 172.21.15.12:0/1947822934 wait complete. 2024-04-26T18:09:17.393 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T18:09:17.493 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.494+0000 7f7e0b247640 1 Processor -- start 2024-04-26T18:09:17.494 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.494+0000 7f7e0b247640 1 -- start start 2024-04-26T18:09:17.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e0b247640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e040b4370 0x7f7e0415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e0b247640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 0x7f7e040ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.495 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e0b247640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e0415fa00 con 0x7f7e040ce070 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e0b247640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f7e040cc090 con 0x7f7e040b4370 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e0b247640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f7e0415fce0 con 0x7f7e040ce450 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e040b4370 0x7f7e0415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7e040b4370 0x7f7e0415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36044/0 (socket says 172.21.15.12:36044) 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 -- 172.21.15.12:0/3004295686 learned_addr learned my addr 172.21.15.12:0/3004295686 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e097e4640 1 --2- 172.21.15.12:0/3004295686 >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 0x7f7e040ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.496 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 -- 172.21.15.12:0/3004295686 >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 msgr2=0x7f7e040ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3004295686 >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 0x7f7e040ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 -- 172.21.15.12:0/3004295686 >> v1:172.21.15.100:6789/0 conn(0x7f7e040ce070 legacy=0x7f7e0415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e03fff640 1 -- 172.21.15.12:0/3004295686 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0415ffc0 con 0x7f7e040b4370 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.495+0000 7f7e097e4640 1 --2- 172.21.15.12:0/3004295686 >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 0x7f7e040ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.496+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3004295686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e0415bbd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7e040b3eb0 tx=0x7f7df002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8bd0ac6233eb74 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.496+0000 7f7e037fe640 1 -- 172.21.15.12:0/3004295686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0037070 con 0x7f7e040b4370 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.496+0000 7f7e037fe640 1 -- 172.21.15.12:0/3004295686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7df0032440 con 0x7f7e040b4370 2024-04-26T18:09:17.497 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.496+0000 7f7e037fe640 1 -- 172.21.15.12:0/3004295686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df0032830 con 0x7f7e040b4370 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 -- 172.21.15.12:0/3004295686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 msgr2=0x7f7e0415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3004295686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e0415bbd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7e040b3eb0 tx=0x7f7df002a1a0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 -- 172.21.15.12:0/3004295686 shutdown_connections 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3004295686 >> v2:172.21.15.100:3300/0 conn(0x7f7e040ce450 0x7f7e040ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3004295686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e0415bbd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 -- 172.21.15.12:0/3004295686 >> 172.21.15.12:0/3004295686 conn(0x7f7e040743c0 msgr2=0x7f7e04068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 -- 172.21.15.12:0/3004295686 shutdown_connections 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.497+0000 7f7e0b247640 1 -- 172.21.15.12:0/3004295686 wait complete. 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.498+0000 7f7e0b247640 1 Processor -- start 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.498+0000 7f7e0b247640 1 -- start start 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 0x7f7e041f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 0x7f7e040c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.503 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040cd020 con 0x7f7e040b4370 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040cc5c0 con 0x7f7e040ce070 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7e040cd1a0 con 0x7f7e040ce450 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36060/0 (socket says 172.21.15.12:36060) 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 -- 172.21.15.12:0/3697783251 learned_addr learned my addr 172.21.15.12:0/3697783251 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e097e4640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 0x7f7e040c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 0x7f7e041f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 -- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 msgr2=0x7f7e040c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 0x7f7e040c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 -- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 msgr2=0x7f7e041f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 0x7f7e041f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 -- 172.21.15.12:0/3697783251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0415abb0 con 0x7f7e040b4370 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e097e4640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 0x7f7e040c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 0x7f7e041f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e08fe3640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c430 tx=0x7f7df800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8011790 con 0x7f7e040b4370 2024-04-26T18:09:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7df8017070 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0415ae90 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df8011bd0 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.499+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e04154860 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.500+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e04076d20 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.501+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7df801c460 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.501+0000 7f7e017fa640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 0x7f7de806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.502+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7f7df808bf20 con 0x7f7e040b4370 2024-04-26T18:09:17.506 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.502+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 0x7f7de806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.502+0000 7f7e03fff640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 0x7f7de806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7df0034000 tx=0x7f7df002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.507 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.506+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7df8059e80 con 0x7f7e040b4370 2024-04-26T18:09:17.692 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.693+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e0415b3b0 con 0x7f7e040b4370 2024-04-26T18:09:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.694+0000 7f7e017fa640 1 -- 172.21.15.12:0/3697783251 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+19032 (secure 0 0 0) 0x7f7df8059780 con 0x7f7e040b4370 2024-04-26T18:09:17.693 INFO:teuthology.orchestra.run.smithi012.stdout: 2024-04-26T18:09:17.693 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"fsid":"68faa4ec-4899-41e7-bbbd-182baff15e13","created":"2024-04-26T17:57:49.693958+0000","modified":"2024-04-26T18:03:29.528985+0000","last_up_change":"2024-04-26T17:58:01.004382+0000","last_in_change":"2024-04-26T17:57:51.824943+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T17:58:01.889463+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-26T17:58:10.706842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-26T17:58:11.802389+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-26T17:58:15.507579+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":35,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1adbc690-5e83-47f4-ab1e-685843b3a483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6801","nonce":1222565562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6803","nonce":1222565562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6807","nonce":1222565562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":1222565562},{"type":"v1","addr":"172.21.15.12:6805","nonce":1222565562}]},"public_addr":"172.21.15.12:6801/1222565562","cluster_addr":"172.21.15.12:6803/1222565562","heartbeat_back_addr":"172.21.15.12:6807/1222565562","heartbeat_front_addr":"172.21.15.12:6805/1222565562","state":["exists","up"]},{"osd":1,"uuid":"e554ee8b-7026-48fb-b482-9df9f0f8f377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6823","nonce":214863022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6827","nonce":214863022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6830","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6831","nonce":214863022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":214863022},{"type":"v1","addr":"172.21.15.12:6829","nonce":214863022}]},"public_addr":"172.21.15.12:6823/214863022","cluster_addr":"172.21.15.12:6827/214863022","heartbeat_back_addr":"172.21.15.12:6831/214863022","heartbeat_front_addr":"172.21.15.12:6829/214863022","state":["exists","up"]},{"osd":2,"uuid":"5a9ecd91-5d7c-4e14-bb90-53e2eb5422ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6812","nonce":1580244255}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6817","nonce":1580244255}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6826","nonce":1580244255}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6819","nonce":1580244255},{"type":"v1","addr":"172.21.15.12:6821","nonce":1580244255}]},"public_addr":"172.21.15.12:6812/1580244255","cluster_addr":"172.21.15.12:6817/1580244255","heartbeat_back_addr":"172.21.15.12:6826/1580244255","heartbeat_front_addr":"172.21.15.12:6821/1580244255","state":["exists","up"]},{"osd":3,"uuid":"8e0a96b3-1f52-4c2f-96d6-3d3c61451dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6809","nonce":3057566562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6811","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6813","nonce":3057566562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6820","nonce":3057566562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":3057566562},{"type":"v1","addr":"172.21.15.12:6816","nonce":3057566562}]},"public_addr":"172.21.15.12:6809/3057566562","cluster_addr":"172.21.15.12:6813/3057566562","heartbeat_back_addr":"172.21.15.12:6820/3057566562","heartbeat_front_addr":"172.21.15.12:6816/3057566562","state":["exists","up"]},{"osd":4,"uuid":"49037eb9-6acc-47aa-aa02-f6f234754e9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6801","nonce":2805574331}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6805","nonce":2805574331}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6813","nonce":2805574331}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":2805574331},{"type":"v1","addr":"172.21.15.100:6809","nonce":2805574331}]},"public_addr":"172.21.15.100:6801/2805574331","cluster_addr":"172.21.15.100:6805/2805574331","heartbeat_back_addr":"172.21.15.100:6813/2805574331","heartbeat_front_addr":"172.21.15.100:6809/2805574331","state":["exists","up"]},{"osd":5,"uuid":"0de27771-aa00-462a-b1db-c1fe635d3d2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6804","nonce":4224810891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6808","nonce":4224810891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6815","nonce":4224810891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":4224810891},{"type":"v1","addr":"172.21.15.100:6812","nonce":4224810891}]},"public_addr":"172.21.15.100:6804/4224810891","cluster_addr":"172.21.15.100:6808/4224810891","heartbeat_back_addr":"172.21.15.100:6815/4224810891","heartbeat_front_addr":"172.21.15.100:6812/4224810891","state":["exists","up"]},{"osd":6,"uuid":"4c45c193-312c-48f1-9a12-92b2bc39aa9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6825","nonce":862079515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6827","nonce":862079515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6831","nonce":862079515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":862079515},{"type":"v1","addr":"172.21.15.100:6829","nonce":862079515}]},"public_addr":"172.21.15.100:6825/862079515","cluster_addr":"172.21.15.100:6827/862079515","heartbeat_back_addr":"172.21.15.100:6831/862079515","heartbeat_front_addr":"172.21.15.100:6829/862079515","state":["exists","up"]},{"osd":7,"uuid":"ca17a682-4f39-444f-8dcb-1bf4b65c17d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6817","nonce":2213109725}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6819","nonce":2213109725}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6823","nonce":2213109725}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":2213109725},{"type":"v1","addr":"172.21.15.100:6821","nonce":2213109725}]},"public_addr":"172.21.15.100:6817/2213109725","cluster_addr":"172.21.15.100:6819/2213109725","heartbeat_back_addr":"172.21.15.100:6823/2213109725","heartbeat_front_addr":"172.21.15.100:6821/2213109725","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.002880+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.921009+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.034625+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967574+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.993268+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.046152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:57.022685+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T17:57:56.967534+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":476,"length":30}]},{"pool":4,"snaps":[{"begin":476,"length":30}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T18:09:17.695 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 msgr2=0x7f7de806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 0x7f7de806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7df0034000 tx=0x7f7df002e000 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 msgr2=0x7f7e041f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7df800c430 tx=0x7f7df800c8f0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 shutdown_connections 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f7de806c8f0 0x7f7de806edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7e040ce450 0x7f7e040c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7e040ce070 0x7f7e041f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 --2- 172.21.15.12:0/3697783251 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e040b4370 0x7f7e041f4a60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 >> 172.21.15.12:0/3697783251 conn(0x7f7e040743c0 msgr2=0x7f7e04150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 shutdown_connections 2024-04-26T18:09:17.697 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.696+0000 7f7e0b247640 1 -- 172.21.15.12:0/3697783251 wait complete. 2024-04-26T18:09:17.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T18:09:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.809+0000 7fa4dd615640 1 Processor -- start 2024-04-26T18:09:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.809+0000 7fa4dd615640 1 -- start start 2024-04-26T18:09:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4dd615640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d8155f70 0x7fa4d815f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4dd615640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4d80cdc90 0x7fa4d8166480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4dd615640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d815f190 con 0x7fa4d80c6530 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4dd615640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d80cc1c0 con 0x7fa4d80cdc90 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4dd615640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d815f4c0 con 0x7fa4d8155f70 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4d77fe640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4d80cdc90 0x7fa4d8166480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4d67fc640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa4d80c6530 0x7fa4d80cd580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41104/0 (socket says 172.21.15.12:41104) 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4d67fc640 1 -- 172.21.15.12:0/730523644 learned_addr learned my addr 172.21.15.12:0/730523644 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.810+0000 7fa4d6ffd640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d8155f70 0x7fa4d815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d77fe640 1 -- 172.21.15.12:0/730523644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d8155f70 msgr2=0x7fa4d815f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d77fe640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d8155f70 0x7fa4d815f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d77fe640 1 -- 172.21.15.12:0/730523644 >> v1:172.21.15.12:6789/0 conn(0x7fa4d80c6530 legacy=0x7fa4d80cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d5ffb640 1 -- 172.21.15.12:0/730523644 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838518786 0 0) 0x7fa4d815f190 con 0x7fa4d80c6530 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d77fe640 1 -- 172.21.15.12:0/730523644 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d815c970 con 0x7fa4d80cdc90 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d77fe640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d80cdc90 0x7fa4d8166480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d5df73232c2e47 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d5ffb640 1 -- 172.21.15.12:0/730523644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007740 con 0x7fa4d80cdc90 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d5ffb640 1 -- 172.21.15.12:0/730523644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4c80078e0 con 0x7fa4d80cdc90 2024-04-26T18:09:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.811+0000 7fa4d5ffb640 1 -- 172.21.15.12:0/730523644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007cd0 con 0x7fa4d80cdc90 2024-04-26T18:09:17.815 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 -- 172.21.15.12:0/730523644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d80cdc90 msgr2=0x7fa4d8166480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.818 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d80cdc90 0x7fa4d8166480 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c802a6f0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 -- 172.21.15.12:0/730523644 shutdown_connections 2024-04-26T18:09:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d80cdc90 0x7fa4d8166480 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.819 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 --2- 172.21.15.12:0/730523644 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d8155f70 0x7fa4d815f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 -- 172.21.15.12:0/730523644 >> 172.21.15.12:0/730523644 conn(0x7fa4d8074500 msgr2=0x7fa4d8068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 -- 172.21.15.12:0/730523644 shutdown_connections 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.812+0000 7fa4dd615640 1 -- 172.21.15.12:0/730523644 wait complete. 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.813+0000 7fa4dd615640 1 Processor -- start 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.813+0000 7fa4dd615640 1 -- start start 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d80c6530 0x7fa4d81f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d80cdc90 0x7fa4d815e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.820 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80c6a80 con 0x7fa4d8155f70 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80cc6f0 con 0x7fa4d80cdc90 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4dd615640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d80ce5b0 con 0x7fa4d80c6530 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4d77fe640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36078/0 (socket says 172.21.15.12:36078) 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4d77fe640 1 -- 172.21.15.12:0/1230165745 learned_addr learned my addr 172.21.15.12:0/1230165745 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4d6ffd640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d80c6530 0x7fa4d81f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.814+0000 7fa4d67fc640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d80cdc90 0x7fa4d815e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.821 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 -- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d80c6530 msgr2=0x7fa4d81f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d80c6530 0x7fa4d81f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 -- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d80cdc90 msgr2=0x7fa4d815e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d80cdc90 0x7fa4d815e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 -- 172.21.15.12:0/1230165745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d80cf580 con 0x7fa4d8155f70 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4d77fe640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8041070 con 0x7fa4d8155f70 2024-04-26T18:09:17.822 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa4c8031c40 con 0x7fa4d8155f70 2024-04-26T18:09:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8009450 con 0x7fa4d8155f70 2024-04-26T18:09:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d80cf860 con 0x7fa4d8155f70 2024-04-26T18:09:17.823 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.815+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d80cfe20 con 0x7fa4d8155f70 2024-04-26T18:09:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.816+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4d80cba20 con 0x7fa4d8155f70 2024-04-26T18:09:17.824 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.816+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4c8039040 con 0x7fa4d8155f70 2024-04-26T18:09:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.817+0000 7fa4cf7fe640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 0x7fa4b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.817+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6791+0+0 (secure 0 0 0) 0x7fa4c80ad1e0 con 0x7fa4d8155f70 2024-04-26T18:09:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.817+0000 7fa4d6ffd640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 0x7fa4b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.818+0000 7fa4d6ffd640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 0x7fa4b806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009b40 tx=0x7fa4d0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:17.825 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:17.821+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa4d80cba20 con 0x7fa4d8155f70 2024-04-26T18:09:18.045 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.046+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa4d8069600 con 0x7fa4d8155f70 2024-04-26T18:09:18.047 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.048+0000 7fa4cf7fe640 1 -- 172.21.15.12:0/1230165745 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7fa4d8069600 con 0x7fa4d8155f70 2024-04-26T18:09:18.047 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T18:09:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.051+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 msgr2=0x7fa4b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.051+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 0x7fa4b806edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009b40 tx=0x7fa4d0009190 comp rx=0 tx=0).stop 2024-04-26T18:09:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.051+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 msgr2=0x7fa4d80d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.050 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.051+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009d90 tx=0x7fa4c8004a40 comp rx=0 tx=0).stop 2024-04-26T18:09:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 shutdown_connections 2024-04-26T18:09:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4d8155f70 0x7fa4d80d0e20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa4d80cdc90 0x7fa4d815e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.051 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fa4b806c8f0 0x7fa4b806edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 --2- 172.21.15.12:0/1230165745 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa4d80c6530 0x7fa4d81f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 >> 172.21.15.12:0/1230165745 conn(0x7fa4d8074500 msgr2=0x7fa4d80c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 shutdown_connections 2024-04-26T18:09:18.052 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.052+0000 7fa4dd615640 1 -- 172.21.15.12:0/1230165745 wait complete. 2024-04-26T18:09:18.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T18:09:18.097 INFO:tasks.ceph.mds.b.smithi100.stdout:starting mds.b at 2024-04-26T18:09:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 Processor -- start 2024-04-26T18:09:18.167 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 -- start start 2024-04-26T18:09:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f94bc156150 0x7f94bc15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94bc0c6860 0x7f94bc15f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.168 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94bc0cc2a0 con 0x7f94bc155d70 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc0cc070 con 0x7f94bc0c6860 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.168+0000 7f94c222a640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f94bc15c850 con 0x7f94bc156150 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bbfff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f94bc0c6860 0x7f94bc15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bb7fe640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f94bc155d70 0x7f94bc0d1320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41120/0 (socket says 172.21.15.12:41120) 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bb7fe640 1 -- 172.21.15.12:0/942215199 learned_addr learned my addr 172.21.15.12:0/942215199 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:09:18.169 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94baffd640 1 --2- 172.21.15.12:0/942215199 >> v2:172.21.15.100:3300/0 conn(0x7f94bc156150 0x7f94bc15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bbfff640 1 -- 172.21.15.12:0/942215199 >> v2:172.21.15.100:3300/0 conn(0x7f94bc156150 msgr2=0x7f94bc15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bbfff640 1 --2- 172.21.15.12:0/942215199 >> v2:172.21.15.100:3300/0 conn(0x7f94bc156150 0x7f94bc15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bbfff640 1 -- 172.21.15.12:0/942215199 >> v1:172.21.15.12:6789/0 conn(0x7f94bc155d70 legacy=0x7f94bc0d1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94bbfff640 1 -- 172.21.15.12:0/942215199 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc15bf20 con 0x7f94bc0c6860 2024-04-26T18:09:18.170 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.169+0000 7f94ba7fc640 1 -- 172.21.15.12:0/942215199 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738356920 0 0) 0x7f94bc0cc2a0 con 0x7f94bc155d70 2024-04-26T18:09:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94bbfff640 1 --2- 172.21.15.12:0/942215199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc0c6860 0x7f94bc15f720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94bc074aa0 tx=0x7f94b402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545886b32e85e5db server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:18.173 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94ba7fc640 1 -- 172.21.15.12:0/942215199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007740 con 0x7f94bc0c6860 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94ba7fc640 1 -- 172.21.15.12:0/942215199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f94b40078e0 con 0x7f94bc0c6860 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94ba7fc640 1 -- 172.21.15.12:0/942215199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4007cd0 con 0x7f94bc0c6860 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 -- 172.21.15.12:0/942215199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc0c6860 msgr2=0x7f94bc15f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 --2- 172.21.15.12:0/942215199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc0c6860 0x7f94bc15f720 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94bc074aa0 tx=0x7f94b402a710 comp rx=0 tx=0).stop 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 -- 172.21.15.12:0/942215199 shutdown_connections 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 --2- 172.21.15.12:0/942215199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc0c6860 0x7f94bc15f720 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 --2- 172.21.15.12:0/942215199 >> v2:172.21.15.100:3300/0 conn(0x7f94bc156150 0x7f94bc15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.174 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 -- 172.21.15.12:0/942215199 >> 172.21.15.12:0/942215199 conn(0x7f94bc076100 msgr2=0x7f94bc073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 -- 172.21.15.12:0/942215199 shutdown_connections 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.170+0000 7f94c222a640 1 -- 172.21.15.12:0/942215199 wait complete. 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.171+0000 7f94c222a640 1 Processor -- start 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 -- start start 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 0x7f94bc151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 0x7f94bc15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.175 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc15bbf0 con 0x7f94bc156150 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f94bc15c4e0 con 0x7f94bc0c6860 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94c222a640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f94bc0cda10 con 0x7f94bc155d70 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94bbfff640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36098/0 (socket says 172.21.15.12:36098) 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.172+0000 7f94bbfff640 1 -- 172.21.15.12:0/1087145791 learned_addr learned my addr 172.21.15.12:0/1087145791 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94baffd640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 0x7f94bc15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bb7fe640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 0x7f94bc151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 -- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 msgr2=0x7f94bc15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.176 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 0x7f94bc15cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 -- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 msgr2=0x7f94bc151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 0x7f94bc151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 -- 172.21.15.12:0/1087145791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94bc1f0f80 con 0x7f94bc156150 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94baffd640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 0x7f94bc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bb7fe640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 0x7f94bc151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94bbfff640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009e80 tx=0x7f94b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4040070 con 0x7f94bc156150 2024-04-26T18:09:18.177 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f94b4031bc0 con 0x7f94bc156150 2024-04-26T18:09:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94bc1f1240 con 0x7f94bc156150 2024-04-26T18:09:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b4045460 con 0x7f94bc156150 2024-04-26T18:09:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.173+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94bc1f1800 con 0x7f94bc156150 2024-04-26T18:09:18.178 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.174+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94bc15b440 con 0x7f94bc156150 2024-04-26T18:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.175+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94b4039040 con 0x7f94bc156150 2024-04-26T18:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.175+0000 7f94a3fff640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 0x7f94a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.175+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6821+0+0 (secure 0 0 0) 0x7f94b40ad940 con 0x7f94bc156150 2024-04-26T18:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.175+0000 7f94bb7fe640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 0x7f94a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.176+0000 7f94bb7fe640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 0x7f94a806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000f60 tx=0x7f94ac007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:18.180 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.179+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f94bc15b440 con 0x7f94bc156150 2024-04-26T18:09:18.410 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:18.411+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f94bc076d20 con 0x7f94bc156150 2024-04-26T18:09:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.056+0000 7f94a3fff640 1 -- 172.21.15.12:0/1087145791 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f94b407b880 con 0x7f94bc156150 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 msgr2=0x7f94a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 0x7f94a806edb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94ac000f60 tx=0x7f94ac007c10 comp rx=0 tx=0).stop 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 msgr2=0x7f94bc151cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94b4009e80 tx=0x7f94b4004a40 comp rx=0 tx=0).stop 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 shutdown_connections 2024-04-26T18:09:19.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94bc156150 0x7f94bc151cb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f94a806c8f0 0x7f94a806edb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f94bc155d70 0x7f94bc15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 --2- 172.21.15.12:0/1087145791 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94bc0c6860 0x7f94bc151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.059+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 >> 172.21.15.12:0/1087145791 conn(0x7f94bc076100 msgr2=0x7f94bc15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.060+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 shutdown_connections 2024-04-26T18:09:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.060+0000 7f94c222a640 1 -- 172.21.15.12:0/1087145791 wait complete. 2024-04-26T18:09:19.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T18:09:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.185+0000 7fea4107b640 1 Processor -- start 2024-04-26T18:09:19.185 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.185+0000 7fea4107b640 1 -- start start 2024-04-26T18:09:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea4107b640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea3c155f30 0x7fea3c15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea4107b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.188 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea4107b640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea3c15f2d0 con 0x7fea3c0cc210 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea4107b640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7fea3c15fe70 con 0x7fea3c155f30 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea4107b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fea3c15cc00 con 0x7fea3c0cd830 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea3c155f30 0x7fea3c15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3b59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3ad9d640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fea3c155f30 0x7fea3c15c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.12:39592/0 (socket says 172.21.15.12:39592) 2024-04-26T18:09:19.189 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3ad9d640 1 -- 172.21.15.12:0/1904099168 learned_addr learned my addr 172.21.15.12:0/1904099168 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3b59e640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.12:37400/0 (socket says 172.21.15.12:37400) 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.186+0000 7fea3a59c640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fea3c0cc210 0x7fea3c0d12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.12:47922/0 (socket says 172.21.15.12:47922) 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3ad9d640 1 -- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 msgr2=0x7fea3c0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3ad9d640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3ad9d640 1 -- 172.21.15.12:0/1904099168 >> v1:172.21.15.100:6789/0 conn(0x7fea3c0cc210 legacy=0x7fea3c0d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3ad9d640 1 -- 172.21.15.12:0/1904099168 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c15f540 con 0x7fea3c155f30 2024-04-26T18:09:19.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea39d9b640 1 -- 172.21.15.12:0/1904099168 <== mon.1 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378323860 0 0) 0x7fea3c15f2d0 con 0x7fea3c0cc210 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3b59e640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.187+0000 7fea3ad9d640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c15c6c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea34009870 tx=0x7fea3402a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e54d614161261d21 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea39d9b640 1 -- 172.21.15.12:0/1904099168 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34037070 con 0x7fea3c155f30 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea39d9b640 1 -- 172.21.15.12:0/1904099168 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea34032440 con 0x7fea3c155f30 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea39d9b640 1 -- 172.21.15.12:0/1904099168 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34032830 con 0x7fea3c155f30 2024-04-26T18:09:19.191 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 -- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 msgr2=0x7fea3c15c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c15c6c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fea34009870 tx=0x7fea3402a250 comp rx=0 tx=0).stop 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 -- 172.21.15.12:0/1904099168 shutdown_connections 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cd830 0x7fea3c0c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 --2- 172.21.15.12:0/1904099168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c15c6c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 -- 172.21.15.12:0/1904099168 >> 172.21.15.12:0/1904099168 conn(0x7fea3c068090 msgr2=0x7fea3c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 -- 172.21.15.12:0/1904099168 shutdown_connections 2024-04-26T18:09:19.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.188+0000 7fea4107b640 1 -- 172.21.15.12:0/1904099168 wait complete. 2024-04-26T18:09:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 Processor -- start 2024-04-26T18:09:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 -- start start 2024-04-26T18:09:19.195 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cc210 0x7fea3c1f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c156310 con 0x7fea3c0cd830 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7fea3c15fb00 con 0x7fea3c155f30 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea4107b640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7fea3c0cc730 con 0x7fea3c0cc210 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea3a59c640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36102/0 (socket says 172.21.15.12:36102) 2024-04-26T18:09:19.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea3a59c640 1 -- 172.21.15.12:0/3901385208 learned_addr learned my addr 172.21.15.12:0/3901385208 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea3ad9d640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cc210 0x7fea3c1f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.190+0000 7fea3b59e640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 -- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cc210 msgr2=0x7fea3c1f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cc210 0x7fea3c1f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 -- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 msgr2=0x7fea3c14bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c14bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 -- 172.21.15.12:0/3901385208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea3c14cdd0 con 0x7fea3c0cd830 2024-04-26T18:09:19.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea3a59c640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fea3000c4e0 tx=0x7fea3000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30007540 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea300047e0 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea3c0cf270 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea30004bf0 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.191+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea3c0cf830 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.192+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea3c076d20 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.193+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fea30011070 con 0x7fea3c0cd830 2024-04-26T18:09:19.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.193+0000 7fea237fe640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 0x7fea2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.193+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6821+0+0 (secure 0 0 0) 0x7fea3008bba0 con 0x7fea3c0cd830 2024-04-26T18:09:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.193+0000 7fea3ad9d640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 0x7fea2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.194+0000 7fea3ad9d640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 0x7fea2806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea34034000 tx=0x7fea3402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:19.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.197+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fea30059c30 con 0x7fea3c0cd830 2024-04-26T18:09:19.381 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:19.382+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea3c0cd370 con 0x7fea3c0cd830 2024-04-26T18:09:20.059 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.060+0000 7fea237fe640 1 -- 172.21.15.12:0/3901385208 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) ==== 181+0+0 (secure 0 0 0) 0x7fea30059530 con 0x7fea3c0cd830 2024-04-26T18:09:20.060 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2024-04-26T18:09:20.062 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 msgr2=0x7fea2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.065 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 0x7fea2806edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fea34034000 tx=0x7fea3402e000 comp rx=0 tx=0).stop 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 msgr2=0x7fea3c15b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fea3000c4e0 tx=0x7fea3000c8e0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 shutdown_connections 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea3c155f30 0x7fea3c14bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3c0cd830 0x7fea3c15b1d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7fea2806c8f0 0x7fea2806edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 --2- 172.21.15.12:0/3901385208 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fea3c0cc210 0x7fea3c1f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 >> 172.21.15.12:0/3901385208 conn(0x7fea3c068090 msgr2=0x7fea3c068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:20.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 shutdown_connections 2024-04-26T18:09:20.067 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.063+0000 7fea4107b640 1 -- 172.21.15.12:0/3901385208 wait complete. 2024-04-26T18:09:20.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.191+0000 7f58211c6640 1 Processor -- start 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.191+0000 7f58211c6640 1 -- start start 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f58211c6640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f581c0d1590 0x7f581c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f58211c6640 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c15f370 con 0x7f581c0cc310 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f58211c6640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f581c0cd440 con 0x7f581c0b7110 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f58211c6640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f581c0cd720 con 0x7f581c0d1590 2024-04-26T18:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581a59c640 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f581c0cc310 0x7f581c155bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41130/0 (socket says 172.21.15.12:41130) 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581a59c640 1 -- 172.21.15.12:0/1921454611 learned_addr learned my addr 172.21.15.12:0/1921454611 (peer_addr_for_me v1:172.21.15.12:0/0) 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581ad9d640 1 --2- 172.21.15.12:0/1921454611 >> v2:172.21.15.100:3300/0 conn(0x7f581c0d1590 0x7f581c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602409502 0 0) 0x7f581c15f370 con 0x7f581c0cc310 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5804003520 con 0x7f581c0cc310 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581ad9d640 1 -- 172.21.15.12:0/1921454611 >> v1:172.21.15.100:6789/0 conn(0x7f581c0b7110 legacy=0x7f581c166700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581ad9d640 1 -- 172.21.15.12:0/1921454611 >> v1:172.21.15.12:6789/0 conn(0x7f581c0cc310 legacy=0x7f581c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 211561300 0 0) 0x7f5804003520 con 0x7f581c0cc310 2024-04-26T18:09:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.192+0000 7f581ad9d640 1 -- 172.21.15.12:0/1921454611 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c0cda00 con 0x7f581c0d1590 2024-04-26T18:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.193+0000 7f581ad9d640 1 --2- 172.21.15.12:0/1921454611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0d1590 0x7f581c0c8790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da4934128ed1f53e server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.193+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 <== mon.1 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580c037070 con 0x7f581c0d1590 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.193+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 <== mon.1 v2:172.21.15.100:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f580c02ac50 con 0x7f581c0d1590 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.193+0000 7f5819d9b640 1 -- 172.21.15.12:0/1921454611 <== mon.1 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5810001670 con 0x7f581c0d1590 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 -- 172.21.15.12:0/1921454611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0d1590 msgr2=0x7f581c0c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 --2- 172.21.15.12:0/1921454611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0d1590 0x7f581c0c8790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f580c0097a0 tx=0x7f580c02a1c0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 -- 172.21.15.12:0/1921454611 shutdown_connections 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 --2- 172.21.15.12:0/1921454611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0d1590 0x7f581c0c8790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 -- 172.21.15.12:0/1921454611 >> 172.21.15.12:0/1921454611 conn(0x7f581c0762e0 msgr2=0x7f581c073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 -- 172.21.15.12:0/1921454611 shutdown_connections 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.194+0000 7f58211c6640 1 -- 172.21.15.12:0/1921454611 wait complete. 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.195+0000 7f58211c6640 1 Processor -- start 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.195+0000 7f58211c6640 1 -- start start 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 0x7f581c15e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0cc310 0x7f581c0c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f581c1562d0 con 0x7f581c0d1590 2024-04-26T18:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f581c15f8f0 con 0x7f581c0b7110 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f58211c6640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f581c156450 con 0x7f581c0cc310 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f581b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f581b59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36108/0 (socket says 172.21.15.12:36108) 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f581b59e640 1 -- 172.21.15.12:0/201235129 learned_addr learned my addr 172.21.15.12:0/201235129 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f581ad9d640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 0x7f581c15e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.196+0000 7f581a59c640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0cc310 0x7f581c0c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 -- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0cc310 msgr2=0x7f581c0c5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0cc310 0x7f581c0c5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 -- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 msgr2=0x7f581c15e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 0x7f581c15e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 -- 172.21.15.12:0/201235129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581c14f190 con 0x7f581c0d1590 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581ad9d640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 0x7f581c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f581b59e640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f581400c760 tx=0x7f581400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5814003b70 con 0x7f581c0d1590 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5814003d10 con 0x7f581c0d1590 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f581c1f5cc0 con 0x7f581c0d1590 2024-04-26T18:09:20.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581400aab0 con 0x7f581c0d1590 2024-04-26T18:09:20.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.197+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f581c0c5620 con 0x7f581c0d1590 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.198+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581c076d20 con 0x7f581c0d1590 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.198+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f581400ac50 con 0x7f581c0d1590 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.199+0000 7f58037fe640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 0x7f580806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.199+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6383+0+0 (secure 0 0 0) 0x7f581408bd30 con 0x7f581c0d1590 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.199+0000 7f581ad9d640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 0x7f580806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.200+0000 7f581ad9d640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 0x7f580806edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f580c034000 tx=0x7f580c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.204+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5814059780 con 0x7f581c0d1590 2024-04-26T18:09:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:20.386+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f581c0cf6b0 con 0x7f581c0d1590 2024-04-26T18:09:21.061 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.062+0000 7f58037fe640 1 -- 172.21.15.12:0/201235129 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) ==== 169+0+0 (secure 0 0 0) 0x7f581405da80 con 0x7f581c0d1590 2024-04-26T18:09:21.061 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2024-04-26T18:09:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.065+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 msgr2=0x7f580806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.065+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 0x7f580806edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f580c034000 tx=0x7f580c02e000 comp rx=0 tx=0).stop 2024-04-26T18:09:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.065+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 msgr2=0x7f581c0c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.064 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.065+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f581400c760 tx=0x7f581400cc20 comp rx=0 tx=0).stop 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 shutdown_connections 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f581c0d1590 0x7f581c0c6360 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f580806c8f0 0x7f580806edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f581c0cc310 0x7f581c0c5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 --2- 172.21.15.12:0/201235129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f581c0b7110 0x7f581c15e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.066+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 >> 172.21.15.12:0/201235129 conn(0x7f581c0762e0 msgr2=0x7f581c0cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.067+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 shutdown_connections 2024-04-26T18:09:21.066 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.067+0000 7f58211c6640 1 -- 172.21.15.12:0/201235129 wait complete. 2024-04-26T18:09:21.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-26T18:09:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.191+0000 7f70251f9640 1 Processor -- start 2024-04-26T18:09:21.190 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.191+0000 7f70251f9640 1 -- start start 2024-04-26T18:09:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f70251f9640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7020155e30 0x7f702015fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f70251f9640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70200cde10 0x7f70200ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f70251f9640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f702015bdc0 con 0x7f70200cc380 2024-04-26T18:09:21.192 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f70251f9640 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 -- 0x7f70200ce8c0 con 0x7f70200cde10 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f70251f9640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 -- 0x7f702015c9d0 con 0x7f7020155e30 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70200cde10 0x7f70200ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70200cde10 0x7f70200ce260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36114/0 (socket says 172.21.15.12:36114) 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 -- 172.21.15.12:0/3198425612 learned_addr learned my addr 172.21.15.12:0/3198425612 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f701ed9d640 1 --2- 172.21.15.12:0/3198425612 >> v2:172.21.15.100:3300/0 conn(0x7f7020155e30 0x7f702015fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 -- 172.21.15.12:0/3198425612 >> v2:172.21.15.100:3300/0 conn(0x7f7020155e30 msgr2=0x7f702015fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 --2- 172.21.15.12:0/3198425612 >> v2:172.21.15.100:3300/0 conn(0x7f7020155e30 0x7f702015fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.193 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 -- 172.21.15.12:0/3198425612 >> v1:172.21.15.100:6789/0 conn(0x7f70200cc380 legacy=0x7f70200c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.192+0000 7f7017fff640 1 -- 172.21.15.12:0/3198425612 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702015c0a0 con 0x7f70200cde10 2024-04-26T18:09:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f7017fff640 1 --2- 172.21.15.12:0/3198425612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70200cde10 0x7f70200ce260 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70200ced10 tx=0x7f700802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e518d1d3ec8fe06a server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f701e59c640 1 -- 172.21.15.12:0/3198425612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008037070 con 0x7f70200cde10 2024-04-26T18:09:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f701e59c640 1 -- 172.21.15.12:0/3198425612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f700802ae50 con 0x7f70200cde10 2024-04-26T18:09:21.194 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f701e59c640 1 -- 172.21.15.12:0/3198425612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008032880 con 0x7f70200cde10 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f70251f9640 1 -- 172.21.15.12:0/3198425612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70200cde10 msgr2=0x7f70200ce260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.193+0000 7f70251f9640 1 --2- 172.21.15.12:0/3198425612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70200cde10 0x7f70200ce260 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f70200ced10 tx=0x7f700802a300 comp rx=0 tx=0).stop 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 -- 172.21.15.12:0/3198425612 shutdown_connections 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 --2- 172.21.15.12:0/3198425612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70200cde10 0x7f70200ce260 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 --2- 172.21.15.12:0/3198425612 >> v2:172.21.15.100:3300/0 conn(0x7f7020155e30 0x7f702015fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 -- 172.21.15.12:0/3198425612 >> 172.21.15.12:0/3198425612 conn(0x7f7020068090 msgr2=0x7f7020068470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:21.197 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 -- 172.21.15.12:0/3198425612 shutdown_connections 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.194+0000 7f70251f9640 1 -- 172.21.15.12:0/3198425612 wait complete. 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.195+0000 7f70251f9640 1 Processor -- start 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.195+0000 7f70251f9640 1 -- start start 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.195+0000 7f70251f9640 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 0x7f70200b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.195+0000 7f70251f9640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70200cde10 0x7f70200b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.195+0000 7f70251f9640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70251f9640 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 -- 0x7f7020156210 con 0x7f7020155e30 2024-04-26T18:09:21.198 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70251f9640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 -- 0x7f702015c660 con 0x7f70200cde10 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70251f9640 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 -- 0x7f7020156390 con 0x7f70200cc380 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36124/0 (socket says 172.21.15.12:36124) 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 -- 172.21.15.12:0/3876831543 learned_addr learned my addr 172.21.15.12:0/3876831543 (peer_addr_for_me v2:172.21.15.12:0/0) 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f7017fff640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70200cde10 0x7f70200b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701ed9d640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 0x7f70200b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 -- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 msgr2=0x7f70200b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.199 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 0x7f70200b6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 -- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70200cde10 msgr2=0x7f70200b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70200cde10 0x7f70200b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 -- 172.21.15.12:0/3876831543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70200b5530 con 0x7f7020155e30 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701ed9d640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 0x7f70200b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f701f59e640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f701800c6b0 tx=0x7f701800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018003b70 con 0x7f7020155e30 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7018003d30 con 0x7f7020155e30 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70200b65b0 con 0x7f7020155e30 2024-04-26T18:09:21.200 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018005330 con 0x7f7020155e30 2024-04-26T18:09:21.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.196+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70200b57f0 con 0x7f7020155e30 2024-04-26T18:09:21.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.197+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7020076d20 con 0x7f7020155e30 2024-04-26T18:09:21.201 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.198+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70180054d0 con 0x7f7020155e30 2024-04-26T18:09:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.198+0000 7f70177fe640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 0x7f700006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-26T18:09:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.198+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 5853+0+0 (secure 0 0 0) 0x7f701808baa0 con 0x7f7020155e30 2024-04-26T18:09:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.198+0000 7f701ed9d640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 0x7f700006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-26T18:09:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.199+0000 7f701ed9d640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 0x7f700006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f701000b9f0 tx=0x7f7010008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-26T18:09:21.202 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.203+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7018059db0 con 0x7f7020155e30 2024-04-26T18:09:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:21.390+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7020153da0 con 0x7f7020155e30 2024-04-26T18:09:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.072+0000 7f70177fe640 1 -- 172.21.15.12:0/3876831543 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v40) ==== 178+0+0 (secure 0 0 0) 0x7f70180596b0 con 0x7f7020155e30 2024-04-26T18:09:22.072 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data_ec' removed 2024-04-26T18:09:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.076+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 msgr2=0x7f700006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.076+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 0x7f700006ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f701000b9f0 tx=0x7f7010008040 comp rx=0 tx=0).stop 2024-04-26T18:09:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.076+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 msgr2=0x7f7020152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T18:09:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.076+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f701800c6b0 tx=0x7f701800cb70 comp rx=0 tx=0).stop 2024-04-26T18:09:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 shutdown_connections 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7020155e30 0x7f7020152a90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70200cde10 0x7f70200b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:6832/1835507235,v1:172.21.15.100:6833/1835507235] conn(0x7f700006c920 0x7f700006ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 --2- 172.21.15.12:0/3876831543 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f70200cc380 0x7f70200b6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 >> 172.21.15.12:0/3876831543 conn(0x7f7020068090 msgr2=0x7f70201500d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 shutdown_connections 2024-04-26T18:09:22.077 INFO:teuthology.orchestra.run.smithi012.stderr:2024-04-26T18:09:22.077+0000 7f70251f9640 1 -- 172.21.15.12:0/3876831543 wait complete. 2024-04-26T18:09:22.095 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T18:09:22.096 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T18:09:22.096 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.109 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T18:09:22.110 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-26T18:09:22.110 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.163 INFO:tasks.ceph.mds.c:Stopped 2024-04-26T18:09:22.163 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-26T18:09:22.163 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.215 INFO:tasks.ceph.mds.e:Stopped 2024-04-26T18:09:22.216 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-26T18:09:22.216 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.227 INFO:tasks.ceph.mds.b:Stopped 2024-04-26T18:09:22.227 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-26T18:09:22.227 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.279 INFO:tasks.ceph.mds.d:Stopped 2024-04-26T18:09:22.280 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-26T18:09:22.280 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.332 INFO:tasks.ceph.mds.f:Stopped 2024-04-26T18:09:22.332 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T18:09:22.332 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T18:09:22.332 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.373 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T18:09:22.373 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T18:09:22.373 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.458 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T18:09:22.458 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T18:09:22.458 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.501 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T18:09:22.501 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T18:09:22.502 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.552 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T18:09:22.552 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T18:09:22.552 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.604 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T18:09:22.604 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T18:09:22.604 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.650 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T18:09:22.651 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-26T18:09:22.651 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.695 INFO:tasks.ceph.osd.6:Stopped 2024-04-26T18:09:22.695 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-26T18:09:22.695 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.747 INFO:tasks.ceph.osd.7:Stopped 2024-04-26T18:09:22.747 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T18:09:22.747 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T18:09:22.747 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.772 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T18:09:22.772 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T18:09:22.772 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.798 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T18:09:22.798 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T18:09:22.798 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T18:09:22.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.824 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T18:09:22.824 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T18:09:22.825 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.849 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T18:09:22.850 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T18:09:22.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T18:09:22.900 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T18:09:22.901 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T18:09:22.901 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-26T18:09:22.944 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:09:22.945 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T18:09:23.407 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:09:23.407 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T18:09:23.488 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:09:23.488 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T18:09:23.543 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:09:23.544 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T18:09:23.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T18:09:23.604 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T18:09:24.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T18:09:24.226 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T18:09:24.320 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T18:09:24.320 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-26T18:09:24.380 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T18:09:24.380 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-26T18:09:24.435 INFO:tasks.ceph:Archiving mon data... 2024-04-26T18:09:24.436 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/data/mon.a.tgz 2024-04-26T18:09:24.437 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2024-04-26T18:09:24.455 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.QaocrAWXAu 2024-04-26T18:09:24.456 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.QaocrAWXAu 2024-04-26T18:09:24.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.QaocrAWXAu 2024-04-26T18:09:24.673 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.QaocrAWXAu is 272KB 2024-04-26T18:09:24.769 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.QaocrAWXAu 2024-04-26T18:09:24.785 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/data/mon.b.tgz 2024-04-26T18:09:24.785 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-04-26T18:09:24.802 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.OZx39cY1Rp 2024-04-26T18:09:24.802 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.OZx39cY1Rp 2024-04-26T18:09:24.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.OZx39cY1Rp 2024-04-26T18:09:25.015 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.OZx39cY1Rp is 277KB 2024-04-26T18:09:25.111 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.OZx39cY1Rp 2024-04-26T18:09:25.125 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/data/mon.c.tgz 2024-04-26T18:09:25.126 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-04-26T18:09:25.179 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.xY7TnT1jZi 2024-04-26T18:09:25.179 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xY7TnT1jZi 2024-04-26T18:09:25.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.xY7TnT1jZi 2024-04-26T18:09:25.375 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.xY7TnT1jZi is 277KB 2024-04-26T18:09:25.469 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.xY7TnT1jZi 2024-04-26T18:09:25.484 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T18:09:25.484 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T18:09:25.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T18:09:25.573 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T18:09:25.602 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T18:09:25.602 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T18:09:25.604 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi012/crash 2024-04-26T18:09:25.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T18:09:25.640 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi100/crash 2024-04-26T18:09:25.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T18:09:25.665 INFO:tasks.ceph:Shutting down logrotate 2024-04-26T18:09:25.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:25.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:25.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:25.811 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-26T18:09:25.835 INFO:tasks.ceph:Compressing logs... 2024-04-26T18:09:25.836 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:09:25.854 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T18:09:25.931 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2024-04-26T18:09:25.931 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34880.log 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34629.log: /var/log/ceph/ceph-client.admin.34880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34760.log 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34880.log.gz 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34760.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34760.log.gz 2024-04-26T18:09:25.932 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34840.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34669.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T18:09:25.933 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34713.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34800.log 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34713.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34713.log.gz 2024-04-26T18:09:25.934 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-04-26T18:09:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34800.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34800.log.gz 2024-04-26T18:09:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-26T18:09:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.34589.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-04-26T18:09:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T18:09:25.935 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.d.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-26T18:09:25.974 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43263.log 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44026.log 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47957.log 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44026.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43263.log.gz 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47787.log 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47957.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44026.log.gz 2024-04-26T18:09:25.975 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43601.log 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47787.log.gz 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40706.log 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47957.log.gz 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6%/var/log/ceph/ceph-client.admin.44902.log: -- replaced with /var/log/ceph/ceph-client.admin.43601.log.gz 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41925.log 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40706.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-04-26T18:09:25.976 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49947.log 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40706.log.gz 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50056.log 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42922.log: gzip 89.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.49947.log.gz --verbose 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.44818.log 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44980.log 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44818.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50056.log.gz 2024-04-26T18:09:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51112.log 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.41925.log.gz 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44980.log.gz 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42706.log 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50692.log 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51112.log.gz 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2024-04-26T18:09:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43900.log 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42706.log.gz 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48855.log 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50692.log.gz 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48855.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43900.log.gz 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51364.log 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45172.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48855.log.gz 2024-04-26T18:09:25.979 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51154.log 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51364.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51154.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51364.log.gz 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43597.log 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51154.log.gz 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47830.log 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43597.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47830.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43597.log.gz 2024-04-26T18:09:25.980 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43798.log 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47830.log.gz 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51280.log 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43798.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42580.log 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43798.log.gz 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44557.log 2024-04-26T18:09:25.981 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51280.log.gz 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.44557.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42580.log.gz 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42923.log 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44557.log.gz 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50469.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2024-04-26T18:09:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42923.log.gz 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51070.log 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T18:09:25.983 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50183.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51070.log.gz 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44068.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-04-26T18:09:25.984 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40892.log 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44238.log 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42496.log 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47721.log 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40892.log.gz 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42496.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44238.log.gz 2024-04-26T18:09:25.985 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51238.log 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42496.log.gz 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42921.log 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45312.log 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42921.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51238.log.gz 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-04-26T18:09:25.986 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42921.log.gz 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45312.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28549.log 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45553.log 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45312.log.gz 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.28549.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28549.log.gz 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40808.log 2024-04-26T18:09:25.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45553.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43596.log 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43596.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40808.log.gz 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45553.log.gz 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50734.log 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43596.log.gz 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45510.log 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51608.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-26T18:09:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50734.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45510.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50734.log.gz 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48771.log 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45510.log.gz 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2024-04-26T18:09:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50986.log 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43462.log: /var/log/ceph/ceph-client.admin.50986.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48771.log.gz 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42748.log 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50986.log.gz 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-04-26T18:09:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42748.log: gzip -5 --verbose 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.49704.log 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41294.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42748.log.gz 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz /var/log/ceph/ceph-osd.0.log 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45421.log 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51776.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49704.log.gz 2024-04-26T18:09:25.991 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43261.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45421.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43265.log 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4%/var/log/ceph/ceph-client.admin.43265.log: -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gz 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose 87.2% -- /var/log/ceph/ceph-client.admin.44860.log 2024-04-26T18:09:25.992 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43265.log.gz 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42930.log 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51902.log 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44860.log: /var/log/ceph/ceph-client.admin.42930.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41168.log 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51902.log.gz 2024-04-26T18:09:25.993 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41210.log 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41168.log.gz 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42412.log 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41210.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.50099.log 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41210.log.gz 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40510.log 2024-04-26T18:09:25.994 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50860.log 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42412.log.gz 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50099.log: /var/log/ceph/ceph-client.admin.40510.log: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40510.log.gz 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50099.log.gz 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42209.log 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0%/var/log/ceph/ceph-client.admin.42209.log: -- replaced with /var/log/ceph/ceph-client.admin.50860.log.gz 2024-04-26T18:09:25.995 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49990.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42209.log.gz 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43255.log 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42370.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gz 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42454.log 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43255.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43255.log.gz 2024-04-26T18:09:25.996 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51818.log 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43266.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42454.log.gz 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51196.log 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51818.log: /var/log/ceph/ceph-client.admin.43593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51818.log.gz 2024-04-26T18:09:25.997 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2%/var/log/ceph/ceph-client.admin.51196.log: -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51196.log.gz 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.44734.log 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41336.log 88.3% 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0%/var/log/ceph/ceph-client.admin.41336.log: -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49863.log 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41336.log.gz 2024-04-26T18:09:25.998 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7%/var/log/ceph/ceph-client.admin.49863.log: -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42926.log 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43858.log 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49863.log.gz 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42927.log 2024-04-26T18:09:25.999 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42926.log.gz 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.51508.log 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43858.log.gz 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42927.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34828.log 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51508.log: /var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51508.log.gz 2024-04-26T18:09:26.000 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% 90.8% -- replaced with /var/log/ceph/ceph-client.admin.34828.log.gz 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49661.log: -- /var/log/ceph/ceph-client.admin.45129.log 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48898.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45129.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-04-26T18:09:26.001 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43602.log 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42664.log: gzip -5 --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr: -- /var/log/ceph/ceph-client.admin.41126.log 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50902.log 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43602.log.gz 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8%/var/log/ceph/ceph-client.admin.50902.log: -- replaced with /var/log/ceph/ceph-client.admin.41126.log.gz 2024-04-26T18:09:26.002 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50902.log.gz 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47678.log 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42328.log: /var/log/ceph/ceph-mds.e.log: gzip 88.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.41420.log 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2024-04-26T18:09:26.003 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41420.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47678.log.gz 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50608.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41420.log.gz 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:gzip/var/log/ceph/ceph-client.admin.47551.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50328.log 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50226.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41486.log 2024-04-26T18:09:26.004 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1%/var/log/ceph/ceph-client.admin.50328.log: 93.9% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50328.log.gz 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49015.log 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47914.log 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40850.log 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41486.log.gz 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47914.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49015.log.gz 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 89.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.45062.log 2024-04-26T18:09:26.005 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47914.log.gz 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42622.log 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50371.log 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40850.log.gz 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45062.log: /var/log/ceph/ceph-client.admin.42622.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42622.log.gz 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45062.log.gz 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42151.log 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-04-26T18:09:26.006 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50371.log.gz 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34931.log 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42151.log: /var/log/ceph/ceph-client.admin.43259.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42151.log.gz 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40591.log 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51692.log 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40591.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34931.log.gz 2024-04-26T18:09:26.007 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40591.log.gz 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41252.log 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40980.log 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51734.log: 88.9%/var/log/ceph/ceph-client.admin.41252.log: -- replaced with /var/log/ceph/ceph-client.admin.51692.log.gz 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41252.log.gz 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51448.log 2024-04-26T18:09:26.008 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50818.log 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4%/var/log/ceph/ceph-client.admin.51448.log: -- replaced with /var/log/ceph/ceph-client.admin.40980.log.gz 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43600.log 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51448.log.gz 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41022.log 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50818.log: /var/log/ceph/ceph-client.admin.43600.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41022.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50818.log.gz 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43600.log.gz 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41022.log.gz 2024-04-26T18:09:26.009 INFO:teuthology.orchestra.run.smithi012.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50944.log 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41378.log 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43595.log 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50944.log.gz 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41378.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41378.log.gz 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50776.log 2024-04-26T18:09:26.010 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43595.log.gz 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42538.log 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51028.log 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50776.log.gz 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51322.log 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42538.log.gz 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51028.log.gz/var/log/ceph/ceph-client.admin.43984.log: 2024-04-26T18:09:26.011 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34564.log 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51322.log: /var/log/ceph/ceph-client.admin.45378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34564.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51322.log.gz 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48728.log 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34564.log.gz 2024-04-26T18:09:26.012 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51568.log 2024-04-26T18:09:26.013 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49058.log: /var/log/ceph/ceph-client.admin.48728.log: /var/log/ceph/ceph-client.admin.51568.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48728.log.gz 2024-04-26T18:09:26.013 INFO:teuthology.orchestra.run.smithi012.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2024-04-26T18:09:26.013 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51568.log.gz 2024-04-26T18:09:26.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T18:09:26.101 INFO:teuthology.orchestra.run.smithi100.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T18:09:26.229 INFO:teuthology.orchestra.run.smithi100.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T18:09:26.316 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T18:09:31.203 INFO:teuthology.orchestra.run.smithi012.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T18:09:31.896 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T18:09:32.412 INFO:teuthology.orchestra.run.smithi100.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-26T18:09:33.835 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T18:09:34.763 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T18:09:35.684 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-26T18:09:36.109 INFO:teuthology.orchestra.run.smithi012.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T18:09:36.111 INFO:teuthology.orchestra.run.smithi012.stderr: 2024-04-26T18:09:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m10.244s 2024-04-26T18:09:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m31.850s 2024-04-26T18:09:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m1.050s 2024-04-26T18:09:36.837 INFO:teuthology.orchestra.run.smithi100.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T18:10:07.811 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-26T18:10:07.812 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-04-26T18:10:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m41.915s 2024-04-26T18:10:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:user 1m13.223s 2024-04-26T18:10:07.812 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m2.340s 2024-04-26T18:10:07.812 INFO:tasks.ceph:Archiving logs... 2024-04-26T18:10:07.813 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi012/log 2024-04-26T18:10:07.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:10:13.015 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi100/log 2024-04-26T18:10:13.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T18:10:24.103 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T18:10:24.115 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T18:10:24.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:10:24.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T18:10:24.195 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T18:10:24.205 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T18:10:24.205 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:10:24.208 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T18:10:24.223 INFO:teuthology.orchestra.run.smithi012.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:10:24.226 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-04-26T18:10:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:10:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2024-04-26T18:10:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +1022us[+1055us] +/- 57ms 2024-04-26T18:10:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -400us[ -367us] +/- 76ms 2024-04-26T18:10:24.227 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 -1126us[-1126us] +/- 88ms 2024-04-26T18:10:24.228 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv01.front.sepia.ceph.com 3 6 377 11 +998us[+1004us] +/- 57ms 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 -426us[ -426us] +/- 76ms 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1153us[-1153us] +/- 88ms 2024-04-26T18:10:24.230 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-26T18:10:24.231 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T18:10:24.242 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T18:10:24.243 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T18:10:24.284 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:10:24.354 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-26T18:10:24.419 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:10:24.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:10:24.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-26T18:10:24.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:10:24.477 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T18:10:24.488 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T18:10:24.499 INFO:teuthology.task.internal:Duration was 1144.647676 seconds 2024-04-26T18:10:24.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T18:10:24.509 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T18:10:24.509 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:10:24.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T18:10:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:10:24.555 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-26T18:10:24.850 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T18:10:24.851 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2024-04-26T18:10:24.851 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:10:24.914 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-04-26T18:10:24.914 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T18:10:24.940 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T18:10:24.941 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:10:24.956 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T18:10:25.006 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T18:10:25.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:10:25.028 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T18:10:25.144 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T18:10:25.154 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T18:10:25.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:10:25.180 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T18:10:25.207 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T18:10:25.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:10:25.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:10:25.244 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2024-04-26T18:10:25.269 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-04-26T18:10:25.287 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:10:25.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:10:25.313 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T18:10:25.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T18:10:25.341 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T18:10:25.352 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T18:10:25.353 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi012 2024-04-26T18:10:25.353 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:10:25.387 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903/remote/smithi100 2024-04-26T18:10:25.388 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T18:10:25.421 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T18:10:25.422 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:10:25.424 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T18:10:25.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T18:10:25.495 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T18:10:25.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T18:10:25.507 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T18:10:25.508 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:10:25.510 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T18:10:25.522 INFO:teuthology.orchestra.run.smithi012.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:10 /home/ubuntu/cephtest 2024-04-26T18:10:25.524 INFO:teuthology.orchestra.run.smithi100.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 18:10 /home/ubuntu/cephtest 2024-04-26T18:10:25.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T18:10:25.537 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T18:10:25.565 INFO:teuthology.nuke:Checking targets against current locks 2024-04-26T18:10:25.593 DEBUG:teuthology.nuke:shortname: smithi012 2024-04-26T18:10:25.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T18:10:25.615 DEBUG:teuthology.nuke:shortname: smithi100 2024-04-26T18:10:25.616 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T18:10:25.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:58.396757', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCh4gicuwpWNkWrgMw6npH86SLVh3ZLenmbFRF2tO4z9De5eSKtJQhe/3cfs3OkaGPLEk1kqHVzT7LPscCOYfIg='} 2024-04-26T18:10:25.647 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-26_17:24:23-fs-wip-lusov-quiescer-fixes-distro-default-smithi/7674903', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 17:45:58.394780', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5AauhDX9kwFG0a316z1l/XqokJARJUaIYbaH1QmJs55p4cEfchci940vvkoN3eZIrmq7rOEdUjSKSIm5XvH0k='} 2024-04-26T18:10:25.680 INFO:teuthology.orchestra.console.smithi012:Power off 2024-04-26T18:10:25.680 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T18:10:25.706 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2024-04-26T18:10:25.706 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:25.725 INFO:teuthology.orchestra.console.smithi100:Power off 2024-04-26T18:10:25.725 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T18:10:25.735 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-04-26T18:10:25.749 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-04-26T18:10:25.749 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:25.776 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-26T18:10:29.736 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:29.777 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:29.850 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-04-26T18:10:29.886 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-04-26T18:10:33.852 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:33.888 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:33.964 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2024-04-26T18:10:33.999 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-04-26T18:10:34.100 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-04-26T18:10:37.966 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T18:10:38.078 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2024-04-26T18:10:38.179 INFO:teuthology.orchestra.console.smithi012:Power off completed 2024-04-26T18:10:38.285 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} duration: 1144.6476755142212 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi012 with status 128: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bc94a2a924f4a25e7c0317e85c91b85bf7cac0b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0efdb25c8601412c928dd3030a6edbb3 status: fail success: false 2024-04-26T18:10:38.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T18:10:38.399 INFO:teuthology.run:FAIL